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PREFACE 


•V 


The  purpose  of  chis  volume  Is  twofold.  First,  it  reports  on 
recent  developments  of  singular  perturbation  and  two-time-scale  methods 
for  modeling,  analysis  and  design  of  control  systems.  The  results  obtained 
in  the  last  five  years  are  summarized  in  thirty  papers  which  appeared  in  the 
period  of  1976-1980.  Second,  it  responds  to  the  need  for  a  comprehensive 
and  systematic  treatment  of  this  rapidly  developing  field  of  research.  For 
this  reason , seven  earlier  papers  are  included  and  the  whole  collection  is 
organized  in  a  logical  rather  than  chronological  order.  '  First  three  sections 

j 

deal  with  modeling  and  analysis,  while  the  subsequent  four  sections  are 
devoted  to  the  design  and  optimization  of  linear,  nonlinear  and  stochastic 
control  systems.  The  last  two  sections  treat  large  scale  system  problems 
with  multiple  controllers  and  incomplete  models. 

This  research  has  been  supported  by  several  grants  and  contracts, 
which  are  acknowledged  at  the  end  of  each  paper.  Editing,  publication  and 
dissemination  of  this  volume  is  supported  in  part  by  the  Joint  Services 
Electronics  Program  (U.S.  Army,  U.S.  Navy,  and  U.S.  Air  Force)  under  Contract 
N00014-79-C-0424,  in  part  by  the  U.S.  Air  Force  under  Grant  AFOSR- 78-3633, 


and  in  part  by  the  National  Science  Foundation  under  Grant  ECS-79-19396. 
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Singular  Perturbations  and  Order  Reduction 
in  Control  Theory— An  Overview^ 

P.  V.  KOKOTOVIC4  R.  E.  O'MALLEY,  Jr.§  and  P.  SANNUTIH 

Singular  perturbation  methods  are  physically  motivated  tools  for  order  reduction, 
separation  of  time  scales  and  other  simplifications  in  control  system  analysis  and  design. 


Sararaary — Recent  results  on  singular  perturbations  are 
surveyed  as  a  tool  for  model  order  reduction  end  separation 
of  time  scales  in  control  system  design.  Conceptual  and 
computational  simplifications  of  design  procedures  are 
examined  by  a  discussion  of  their  basic  assumptions.  Over 
100  references  are  organized  into  several  problem  areas. 
The  content  of  main  theorems  is  presented  in  a  tutorial 
form  aimed  at  a  broad  audience  of  engineers  and  applied 
mathematicians  interested  in  control,  estimation  and 
optimization  of  dynamic  systems. 


INTRODUCTION 

Although  many  control  theory  concepts  are  valid 
for  any  system  order,  their  actual  use  is  limited  to 
low  order  models.  In  optimization  of  dynamic 
systems  the  ‘curse  of  dimensionality’  is  not  only  in  a 
formidable  amount  of  computation,  but  also  in  the 
ill-conditioned  initial  and  two  point  boundary 
value  problems.  The  interaction  of  fast  and  slow 
phenomena  in  high-order  systems  results  in  ‘stiff 
numerical  problems  which  require  expensive 
integration  routines. 

The  singular  perturbation  approach  outlined  in 
this  survey  alleviates  both  dimensionality  and 
stiffness  difficulties.  It  lowers  the  model  order  by 
first  neglecting  the  fast  phenomena.  It  then 
improves  the  approximation  by  reintroducing  their 
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effect  as  ‘boundary  layer’  corrections  calculated  in 
separate  time  scales.  Further  improvements  are 
possible  by  asymptotic  expansion  methods.  In 
addition  to  being  helpful  in  design  procedures,  the 
singular  perturbation  approach  is  an  indispensable 
tool  for  analytical  investigations  of  robustness  of 
system  properties,  behavior  of  optimal  controls 
near  singular  arcs,  and  other  effects  of  intentional 
or  unintentional  changes  of  system  order. 

This  paper  is  a  tutorial  survey  of  recent  works  on 
singular  perturbations  in  control  and  estimation 
theory.  Only  several  other  references  are  mentioned 
to  establish  mathematical  background  and  illustrate 
related  approaches.  Among  surveys  and  mono¬ 
graphs  providing  a  broader  view  of  the  field  are 
[Al-10]. 

ORDER  REDUCTION 

Suppose  that  a  dynamic  system  is  modeled  by 

x-f(x,z,u,t,p),  (1) 

pi-g(x,z,u,t,p),  (2) 

where  p  >  0  is  a  scalar  and  x,  z  and  u  are  n-,  m~,  and 
/■-dimensional  vectors,  respectively.  For  p  =»  0,  the 
order  n + m  of  ( 1 , 2)  reduces  to  n,  that  is  (2)  becomes 

0  -  g(x,  f,  u,  /,  0)  (3) 

and  the  substitution  of  a  root  of  (3), 

2  » <f>(x,u,t),  (4) 

into  (1)  yields  a  ‘reduced’  model 

*  »/[*.  <H*> 0. «.  t,  0]  mf(x,  u,  t).  (5) 

The  use  of  p  *  0  is  formal  since  then  t  »  g/p  in  (2) 
may  be  unbounded  for  g  y*  0.  An  analysis  validat¬ 
ing  this  order  reduction  procedure  is  outlined  in  the 
next  section  where  it  also  becomes  apparent  that  a 
reduced  model  (4)  represents  slow  and  neglects  fast 
phenomena  in  (1,  2).  In  this  respect  the  singular 
perturbation  approach  is  related  to  familiar 
“dominant  mode”  techniques  [B2,  E4]  which 
neglect  “high-frequency”  parts  and  retain  “low- 
frequency”  parts  of  models. 
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We  note  that  (3)  may  have  several  roots  each 
resulting  in  a  different  reduced  model  (4).  Most  of 
the  available  theory  is  restricted  to  models  (4) 
corresponding  to  real  and  distinct  roots  of  (3), 
along  which  dgjdz  is  nonsingular.  At  points  where 
dg/dz  is  singular,  :  may  jump  from  one  root  to 
another  [C6].  In  the  special  case  when  g  is  linear  in  z 
the  reduced  model  (4)  is  unique.  For  a  linear  system 


x  =»  /4ux+y4Mr+BiU,  (6) 

7*2  »  AtyX+AnZ  +  B^u  (7) 

the  root  (4)  is 

2  ™  **  A^-1  An  x — An-1  u,  (8) 

yielding  the  reduced  model 

^  “  (Au  ~  Ay  An*1  Aj i)£ 

+  (^i  —  AuAjj-1  Bf)u.  (9) 


In  applications,  models  of  various  physical  systems 
are  put  in  form  (1),  (2)  by  expressing  small  time 
constants  T{,  small  masses  mjt  large  gains  K„  etc.,  as 
Tt  =*  Cif t,  m]  »  cf  h ,  A,  -  Ci/ft,  etc.,  where  c{,  c},  c,  are 
known  coefficients  [A5,B5].  In  power  system 
models  h  can  represent  machine  reactances  or 
transients  in  voltage  regulators  [B8],  in  industrial 
control  systems  it  may  represent  time  constants  of 
drives  and  actuators  [Bll],  in  biochemical  models 
H  can  indicate  a  small  quantity  of  an  enzyme  [B4], 
in  a  flexible  booster  model  h  is  due  to  bending 
modes  [B3]  and  in  nuclear  reactor  models  it  is  due 
to  fast  neutrons  [B7,9, 12].  Singular  perturbations 
are  extensively  used  in  aircraft  and  rocket  flight 
models  [B6, 10, 13, 16],  and  in  chemical  reaction 
diffusion  theory  [B14, 15],  Other  order  reduction 
techniques  [B17]  can  be  interpreted  as  singular 
perturbations  [B18]. 

INITIAL  VALUE  PROBLEMS 

When  does  a  reduced  solution  x,  f  approximate 
the  original  solution  x,  z  and  in  what  sense?  For 
clarity  we  begin  with  the  linear  system  (6,  7), 
assuming  that  it  is  time  invariant  and  that  u  «  0. 
To  exhibit  the  error  z-i  =■  r+AB-l/fai  let 

17  -  z  +  An~1Atlx+HM1x  (10) 

and  choose  Mx  such  that  the  substitution  of  (10) 
into  (6),  (7)  separates  the  17-subsystem  as 

-X  *  (Au  —  Au^jj  lAn  +  n Aft)x+<41|'*7,  (11) 
Mi)~(Aa+pM,)  17.  (12) 

It  is  easily  shown  that  there  exists  7**  >  0  such  that 
M< » Mi  (p),  i  ■  1,2,3,  are  bounded  for  all 
H  s  (0,  fi*].  For  ji->-0  the  eigenvalues  of  the 
independent  17-subsystem  (12)  tend  to  infinity  like 
the  eigenvalues  of  (l !n)An.  Thus  (12)  is  the  ‘fast’ 
part  of  (6,  7).  It  can  be  written  as 

^ -(/I* +^1**),  (13) 


where  r  is  the  ‘stretched  time  scale’  defined  for  all 

r  ■  • — ^2,  r  m  0  at  t »  r0.  (14) 

The  system  (13)  depends  continuously  on  7*  and  at 
H  =*  0  it  becomes 

™  AMij(r).  (15) 

From  (8)  and  (10)  at  71  —  0  the  initial  condition  for 
(15)  is 

tf0)-z(ro)-f(lo)-  (16) 

The  solution  rfa)  of  the  ‘fast’  subsystem  (13)  is  the 
input  to  the  ‘slow’  subsystem  (11).  The  homo¬ 
geneous  part  of  (11)  is  an  0(jx)  perturbation!  of 
the  reduced  model  (9)  with  u  «  0.  If  the  eigenvalues 
of  An  ail  have  negative  real  parts,  then  17(1-) ->-0  as 
t-*-oo,  that  is  for  small  17  as  a  function  of  t  rapidly 
decays  away  from  r0.  Under  this  condition, 
integration  by  parts  in  the  variation  of  parameters 
formula  for  the  solution  of  (11)  yields 

x(t)-m  +  0(H)  (17) 

and,  on  substitution  into  (10), 

r(0«f(0+ij(r)+<?0*).  (18) 

Thus  the  reduced  model  state  x(t)  approximates  the 
x-part  of  the  actual  state,  while  to  approximate  its 
z-part  we  need  both  f(f)  from  (8)  and  t)(t)  from  (14). 
The  ‘boundary  layer’  correction  17 (r)  is  significant 
only  during  a  short  interval  [r0,  fj  after  which 

z(t)~i(t)  +  0(H).  (19) 

A  remarkable  property  of  the  singularly  perturbed 
model  (1,  2)  is  that  the  structure  of  the  approxima¬ 
tion  (17, 18)  remains  the  same  for  time-varying  and 
nonlinear  systems.  This  is  established  by  a  funda¬ 
mental  theorem  due  to  Tihonov  [Cl],  whose 
essential  conditions  are  imposed  on  a  ‘boundary 
layer’  system  for  17  *  z-z 

%;mgl*'2+v(T),u,t,  0],  (20) 

a  nonlinear  analog  of  (15).  By  virtue  of  (3)  an 
equilibrium  of  (20)  is  17-0.  Assuming  the 

existence  and  smoothness  of  .f(r),  z(r)  for 

1 6  [t0,  T],  the  conditions  imposed  on  (20)  are,  first, 
that  t)  -  0  be  an  asymptotically  stable  equilibrium 
of  (20)  at  .t(/o),  z(/0),  «(/„),  /„  with  17(0)  -  z(r0)-f(/0) 
belonging  to  its  domain  of  attraction;  second,  that 
for  all  t  €  [t0,  T]  the  eigenvalues  of  dg/dz  along 
x(f),  z(t),  u(t )  all  have  real  parts  less  than  a  fixed 
negative  number.  Then  (17,  18)  hold  for  all 
l  e  [t0,  T]  and  (19)  holds  for  all  /  e  [i„  7"]. 

t  A  function  of  71  is  denoted  by  Of/**)  when  for  all 
71 6  (0,  /*•]  its  norm  is  less  than  071 where  c  >  0, 74*  >  0  and 
k  are  some  constants. 
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The  proof  of  this  theorem  is  found  in  [Al,8; 
Cl— 3]  and,  under  slightly  weaker  conditions,  in 
[C4J.  The  separation  of  time  scales  is  exemplified 
by  the  fact  that  in  the  boundary  layer  system  the 
variables  X,Z,8  and  t  are  fixed  parameters.  The 
boundary  layer  correction  7j(r)  used  in  (18)  is  the 
solution  of  (20)  with  (16),  where  X,i,i I  and  t  are 
fixed  at  their  values  for  t « 

Expressions  (17)  and  (18)  represent  0(jO 
approximations  of  x(t),  z{t).  If/ and  g  in  (1),  (2) 
possess  k+2  derivatives  in  their  arguments,  then 
x(t),  z(r)  can  be  approximated  up  to  0(jMk)  using 
series  with  terms  depending  on  t  and  terms  depend¬ 
ing  on  r.  These  terms  can  be  generated  by  methods 
in  [A4, 8, 10;  C4, 5]. 

BOUNDARY  VALUE  PROBLEMS 

In  boundary  value  problems  when  z(f)  is  specified 
at  both  t  —  /„  and  t  ■»  T,  two  boundary  layer 
correction  terms  i )L  and  r\R  are  needed  to  compen¬ 
sate  for  r(r0)  -  z  (.*#)  and  z(T)  -  5(7),  respectively.  The 
correction  rjL  is  the  same  as  ij  in  the  initial  value 
problems.  To  define  r)R  an  additional  stretched 
variable  is  introduced  for  all  /i>0, 

a*‘(t—T)ln,  <r  »  0  at  r  *  7",  (21) 

and  (20)  is  rewritten  in  o-scale  with  X,  f,  u  and  t 
fixed  at  their  values  for  t  »  T.  Then  i)R  —  ij«(<t)  is 
its  solution  for  tjr(0)  -  z(T)-!(T).  The  approxi¬ 
mation  of  z(f)  is  sought  in  the  form 

z(t)  »  Z(t)+i]t{T)+riR(a)+0(n)  (22) 

such  that  j/jt  and  ijR  decay  exponentially  as  r-*-oo 
and  a-*--o o,  that  is  their  norms  satisfy  the 
‘dichotomy  condition’ 

||i)Z,||<c1exp(-c,r)  forO^co,  J 

ll7?RlKc»exP (c«a)  for -oo<or«0,  j 

where  ct,  ...,c4  are  positive  constants.  A  simple 
illustration  is  again  the  linear  system  (12).  its 
solutions  in  r  and  a  scales  at  p  «■  0  are 

Vi(?)  -  **pC'4*tT)  71,(0), 

7«(<ri  -  exp(AMa)i?R(0). 

Let  the  first  k  eigenvalues  of  An  have  negative 
real  parts  and  the  remaining  m-k  eigenvalues 
positive  real  parts.  Then  (23)  will  result  if 
rjL(0)  -  r(f0)-i(f0)  belongs  to  the  eigenspace 
corresponding  to  the  first  ^-eigenvalues  of  A&,  and 
if  7«(0)  *  z(T)-i(T)  belongs  to  the  eigenspace 
corresponding  to  the  remaining  m-k  eigenvalues 
of  An.  Under  this  condition  (17)  and  (22)  hold  for 
all  te[/0,7'],  while  (19)  holds  for  /„ < < f < /, > T. 
In  some  problems  the  initial  conditions  are  always 
in  the  required  subspaces  due  to  the  physical  nature 
of  the  variables  i)L  and  *jR.  In  others,  they  have  to 


be  set  there  by  the  user.  Since  it  cannot  be  done 
exactly,  such  problems  may  appear  ill-posed. 
Fortunately,  it  follows  from  [G6,  13]  that  control 
problems  allowing  combined  open  loop-feedback 
realizations  are  well  posed  in  this  sense. 

In  nonlinear  problems  dg/dz  along  X(t),  5(0,  8(0 
is  assumed  to  possess  the  above  eigenvalue  distribu¬ 
tion  throughout  the  interval  Also  z(fo)- 

?(fo)  and  z(T)-2(T)  are  restricted  to  be  on  mani¬ 
folds  for  which  the  equilibrium  tj  »•  0  of  (20)  is 
attractive  in  forward  and  reverse  directions  of  t, 
respectively.  Then  (17)  and  (22)  hold  for  all 
re[r0>7'].  Higher  order  approximations  are 
possible  by  asymptotic  expansions  (A4, 8, 10;  C4]. 

In  a  wider  class  of  ‘matched’  expansion  methods 
[A3, 9]  other  conditions  for  ‘matching’  of  ‘outer’ 
(slow)  and  ‘inner’  (fast)  terms  are  used.  They  are 
often  motivated  by  specific  applications,  such  as  in 
inter-planetary  guidance  problems  [D6].  The 
conditions  outlined  here  originate  from  [A1  ;Dl-5] 
and  can  be  found  in  more  recent  works  [A8, 10; 
D7,8]  and,  in  a  compact  form,  'n  [D9],  These 
conditions  are  particularly  sui  .  for  optimal 
control  problems  whose  Hamilt  n  symmetry  is 
related  to  the  dichotomy  (23).  tical  implica¬ 

tions  of  this  relationship  are  ~ussed  in  the 
section  on  ‘Trajectory  Optimiza- 

STABILITY  AND  STABIL  «UTY 

In  approximations  discussed  so  far  stability 
requirements  were  imposed  only  on  (20),  and  the 
reduced  solution  x(t)  was  permitted  to  be  unstable. 
In  infinite  time-interval  problems  it  is  of  interest  to 
establish  stability  properties  of  x{t),  z(f)  from 
stability  properties  of  k{t)  and  i)(t).  Several  such 
results  are  available. 

For  linear  time-invariant  systems  a  stability 
result  immediately  follows  from  the  upper  triangular 
form  of  the  system  (11,  12).  Its  m+n  eigenvalues 
are  perturbations  of  the  n  eigenvalues  of  Au  — 
AltAn~lAn  and  of  the  m  eigenvalues  of  (1  ly.)A&. 
If  the  real  parts  of  these  eigenvalues  are  negative, 

ReA{i4tt}<0,  Re  -  Alt  A^1  /<u}  <  0,  (25) 

that  is,  if  the  reduced  solution .?(/)  and  the  boundary 
layer  correction  ij(t)  are  asymptotically  stable,  then 
there  exists  /**>0  such  that  the  original  solution 
x(/),  z(/)  is  asymptotically  stable  for  all  p  e  [0,  /a*]. 
For  linear  time-varying  systems  a  similar  condition 
is  derived  in  [El,  7],  assuming  that  the  reduced 
model  be  uniformly  asymptotically  stable  and  that 
for  t  ?  t0  the  eigenvalues  of  /4tt(0  have  real  pans 
less  than  a  fixed  negative  number  -8.  This 
contrasts  with  the  general  case  in  which  Re  A{F(r)} 
<  -  8  for  all  t  does  not  imply  stability  of  v  »  F(t)  v. 

In  nonlinear  systems  the  first  requirement  of  (25) 
is  imposed  on  the  eigenvalues  of  dg/dz  evaluated 
along  J ?(f),  5(f),  8(t)  for  all  t>t0.  In  addition. 
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x(t),  1(f)  and 

F(t) 


dx  8z  \ez)  dx 


(26) 


evaluated  along  .x(t),  f(/),  u(t )  are  assumed  to  have 
finite  limits  .x(oc),  f(oo)  and  F( oc)  as  where 
ReA{F(oo)}<0.  Then,  if  x{Q  and  r(f„)  are  in  the 
appropriate  domain  of  attraction,  the  limits  x(t ) 
and  z(f)  as  r-*oo  are 


x(t)-+x(°o)  +  0(jx),  z(/)-+z(ac)+0(fi).  (27) 


This  is  the  content  of  the  stability  theorem  in 
[E10],  whose  proof,  along  with  an  estimate  of  the 
domain  of  attraction,  is  given  in  {El  2].  Alternative 
sets  of  conditions  are  given  in  [El].  In  [E5,6] 
similar  conditions  are  employed  to  analyze  stability 
of  networks  with  parasitics,  while  a  problem  of 
absolute  stability  is  discussed  in  [E8]  and  stability 
bounds  for  n  are  estimated  in  [E9],  Some  early 
results  on  stability  of  control  systems  with  infinite 
gain  coefficients  are  found  in  [Bl].  Related 
theorems  on  linear  systems  with  slowly  varying 
coefficients  are  found  in  [E2, 3, 1 1],  [E4,  Section  32] 
and  [E16,  pp.  125-128]. 

A  general  stabilizability  condition  for  linear 
time- varying  systems  is  formulated  in  [G6]. 
Special  cases  for  linear  time-invariant  systems,  are 
discussed  in  [El 3-1 5]. 


REGULATORS  AND  RICCATI  EQUATIONS 

Among  the  most  actively  investigated  singularly 
perturbed  optimal  control  problems  is  the  general 
linear-quadratic  regulator  problem.  For  brevity 
we  consider  only  the  time-invariant  case.  When  the 
system  (6),  (7)  is  optimized  with  respect  to 

/.‘JV/WRiOd/,  (28) 

where  y  »  C,.x  +  C*z  and  R>  0,  then  to  implement 
the  optimal  control 

K  X  (29) 

z 

we  have  to  solve 

„  /f4 

K  +  K 

.  /‘Wm  >4 12  Anh*  . 


R~x[By  flj'/H  K+C'C-0. 

(30) 


where  C  =  [C,  C,].  To  avoid  unboundedness  as 
H-+Q  the  solution  is  sought  in  the  form 


K  -  K(n) » 


^ii(m)  /**n(/*)  ‘ 


(30 


which  permits  us  to  set  ft  -  0  in  (30).  At  /i  -  0  an 
mxm  equation  for 

An  Kff  —  Rn  S,  4-  Cj  Ct-0, 

(32) 

where  St  =>  BtR~l  BJ  separates  from  the  ( n+m)x 
(n  +  m)  equation  (30).  If  A^Bf  is  a  stabilizable 
pair,  and  if  An,Ct  is  a  detectable  pair,  then  a 
unique  positive  semidefinite  solution  R^  exists  and 
the  eigenvalues  of  An-StRn  have  negative  real 
parts.  Another  result  of  the  substitution  of  (31) 
into  (30)  is  that  at  /x  —  0  it  is  possible  to  express 
in  terms  of  Rn  and  R&  and  to  obtain  an  nxn 
equation  for  Riv 

Rn A  +  A’RU - Ru SR-1  S'Rn +CC-Q.  (33) 

The  expressions  for  A,  S  and  C  are  given  in  [F5], 
An  interpretation  of  (32)  and  (33)  is  that  (32)  yields 
a  ‘boundary  layer  regulator’  for  the  fast  variable 
tj(t),  and  (33)  yields  the  regulator  for  the  reduced 
state  variable  x(t).  For  A,  S  stabilizable  and  A.  C 
detectable,  the  implicit  function  theorem  applied  to 
(30)  with  (31)  shows  that 

Kq-Xq-MHii),  i,j  =1,2.  (34) 

Not  only  are  the  approximations  Ri}  calculated 
from  lower  order  equations,  but  in  addition  the  ill- 
conditioning  of  (30)  has  been  removed. 

If  Rif  are  used  instead  of  Kit  the  system  (6),  (7) 
with  feedback  control  (29)  becomes 

,x  =>  (An  —  S-y  Ru  —  SR1%  )x  +  (Ayt—  SRfs):,  (35) 
y-i  -  (An-S'  Ru  -  St  *„')  X  +  (An  -  St  R^)  r.  (36) 

where  Sx  =  BlR~lBl'  and  S  =  By  R~v  Bt'.  If  this 
system ;  asymptotically  stable,  then  because  of  (34), 
its  solution  x(f),  :(t)  is  within  0(/i)  of  the  optimal 
solution.  The  stability  condition  (25)  can  now  be 
applied  to  the  feedback  system  (35),  (36).  The 
boundary  layer  stability  condition  is  satisfied  by 
A^-S.Rfg.  The  condition  for  the  reduced  system 
is  satisfied  by  the  solution  of  (33).  Thus  (35),  (36)  is 
a  near-optimal  system. 

The  singularly  perturbed  regulator  problem  was 
posed  in  [FI]  with  C,  -  0  and  An  stable,  which 
gave  Rn  »  0.  The  general  time-varying  problem 
was  treated  in  [F3, 5]  using  the  notion  of  boundary 
layer  controllability-observability.  These  results 
and  extensions  [F6, 7, 9, 10, 13]  are  based  on  the 
singularly  perturbed  differential  Riccati  equation. 
An  alternative  approach  via  boundary  value 
problems  is  presented  in  [G8, 19],  its  relationship 
with  the  Riccati  approach  is  analyzed  in  [FI  2].  In 
[F2]  it  was  shown  that  the  reduced  Riccati  equation 
(33)  can  also  be  obtained  from  the  reduced  model 
(9).  Asymptotic  expansions  are  constructed  in 
[F6,7]  and  applied  to  a  17th  order  power  station 
model  in  [F8],  Two  other  order  reduction 
techniques  [F4, 1 1  ]  lead  to  equations  similar  to  (33) 
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and  it  would  be  of  interest  to  investigate  their 
relationship  with  the  singular  perturbation 
approach. 

TRAJECTORY  OPTIMIZATION 

In  trajectory  optimization  problems  for  the 
system  (1),  (2)  some  conditions  are  imposed  on 
x,z  at  both  t  —  f0  and  t  —  T,  and  a  control  u(t)  is 
sought  to  minimize  the  performance  index 


j  -  r  v(x,z,u,t)dt. 

(37) 

An  optimal  solution  must  satisfy  Hu 

—  0  and 

xm  Hp,  p  *  -H# 

(38) 

pi-Hq,  p4--H„ 

(39) 

with  2/i+ 2m  boundary  conditions. 

Here  Hu,  Hz, 

H„  Hp  - /,  Hq  -  g,  denote  the  partial  derivatives 
of  the  Hamiltonian  H  -  V+p'f+q'g,  and  the 
adjoint  variables  for  (1)  and  (2)  are  p  and  pq, 
respectively.  At  p  ■»  0  we  use  Hq  ■>  0  and  H,  —  0 
to  eliminate  z  and  q  from  (38)  and  to  get  the  reduced 
system 

t-ffp,  p--ftz  (40) 

for  which  only  2 n  conditions  can  be  imposed. 
Suppose  that  they  are  uniquely  satisfied  by  a 
continuously  differentiable  reduced  solution  x(t\ 
p(t).  Since  the  reduced  variables  f(t),  <?(U  obtained 
from  Hq  m  0,  Ht  -  0  may  not  satisfy  the  remaining 
2m  conditions,  corrections  for  r,  and 

for  q,  are  to  be  determined  from 
appropriately  defined  layer  systems 

(41) 

^  />r).  fi&R,  Pr ).  (42) 

where  (41)  is  used  at  f  —  and  (42)  at  t  —  T.  To  be 
specific  consider  the  problem  with  fixed  end  points. 

-'(to)  -  z°.  :(T)  -  rT.  (43) 

Then  the  initial  values  for  qL  and  rjR  are 

Vl(0)  -  2°-f(r0),  ,*(0)  -  zr-I(T)  (44) 
and  the  additional  boundary  conditions  are 

<*-+  —cc-  (45) 

Existence  of  optimal  solutions  and  their  approxima¬ 
tion  by  reduced  solutions  have  been  investigated  in 
[Gl,3,9]  and  extended  in  (G16, 17]  by  a  construc¬ 
tion  of  asymptotic  expansions.  Unfortunately,  the 
applicability  of  these  results  is  restricted  by  the 
requirement  that  jjt(0)  and  rj^O)  be  sufficiently 
small.  To  what  extent  such  restrictions  can  be 
avoided  in  a  general  nonlinear  problem  (1),  (2)  and 
(37)  is  still  an  open  question.  Results  without 


restrictions  on  z°,  zT  are  available  for  linear  time- 
varying  systems  [06,8,13,19]  and  for  a  special 
class  of  nonlinear  systems  [G14, 13,20].  They  are 
briefly  outlined  here. 

Let  the  performance  index  be  (28),  but  on  the 
interval  [t^T],  and  consider  the  trajectory  opti¬ 
mization  problem  for  (6),  (7)  allowing  that  the 
matrices  in  (6),  (7)  and  (28)  be  time  varying. 
Using  a  ‘dichotomy  transformation’  proposed  in 
[06] 

x»li+rv  z-/,+r„  (46) 


where  P(t)  is  a  positive  definite  and  N(t)  is  a 
negative  definite  solution  of  a  differential  equation 
analogous  to  (30),  we  transform  (41),  (42)  into  two 
separate  ‘layer  regulator  systems’ 

^  -  [AM  -  SM  PJf o)l  Vl,  (48) 


^  -  [AJD  ~  SJT)  N*LT))  VR,  (49) 

where  ”  4“4»  V Rmrt~f\  “d  JW'o).  N^T) 
are  the  positive  and  the  negative  definite  roots  of 
(32)  at  /„  and  T.  If  for  all  t  e  [/„,  7*] 

rank  [5*,,  /(„ ...,  Anm  ^ 8j]  *  w,  (50) 
rank [Ct',  Au\ C,'  Ct']  -  m,  (51) 

then  the  approximations  (17),  (22)  and 

p(t)-M  +  0(jx),  (52) 

q(t)  -  ?(0  +  Pa(/0)  Vl + N^T)  T)R  +  O(fi)  (53) 

hold  for  arbitrary  boundary  values  z°,  zT  since  (48), 
(49)  satisfy  the  dichotomy  condition  (23).  A  less 
restrictive  stabilizability-detectability  condition  can 
be  used  instead  of  (50),  (51).  This  result  of  [G13] 
delineates  a  class  of  well-posed  singularly  perturbed 
trajectory  optimization  problems.  The  use  of 
-  R-1 3t'  Pnz+u°  results  in  a  stable  feedback 
realization  of  the  initial  layer  and  u°  -  R~l  BJ(Pn  - 
W't  is  the  open-loop  control  of  the  end-layer. 
An  ‘inverse’  Riccati  approach  to  the  linear  fixed 
end-point  problem  is  developed  in  [F9].  In  [G8]  a 
different  set  of  conditions  is  derived  and  asymptotic 
expansions  are  constructed  for  the  linear  boundary 
value  problem. 

In  [G14, 15]  the  above  results  have  been  extended 
to  the  nonlinear  problem 

X  -  fv(x,  f )  +  /t !,(*,  f )  r  +  ^(.t,  f )  u,  (54) 

pi  -=  3i(x,0  +  An(x,  i)z+ Bt(x,  t)  u,  (55) 

I J K(*, t)+z’Ct’(x, t) C*(.v, /) z 

+«'R(x,r)i/]dr.  (56) 
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It  is  shown  in  [G15]  that,  if  the  matrices  in  (32) 
and  (48H51) are  interpreted  as  the  matrices  of  (54)- 
(56)  evaluated  along  X(t),  then  (50),  (51)  are 
sufficient  for  the  approximation  (17),  (22),  (52), 
(53)  to  hold  for  (54H56)  with  arbitrary  r*.  zT. 
The  conditions  derived  in  [G14]  extend  the  results 
of  [G8]  to  (54H56).  Among  other  works  on 
trajectory  optimization,  [G18]  shows  that  (401  can 
also  be  obtained  from  the  reduced  system,  .Cl] 
analyzes  the  scalar  problem,  [G2,  B5]  give  ap¬ 
proximations  without  layer  corrections  and  [G10] 
makes  an  attempt  to  include  control  inequality 
constraints.  Applications  to  aircraft  control 
problems  are  discussed  in  [G4, 5, 11,12]  and  in 
[B6, 10, 13, 16].  A  class  of  singular  problems  is 
analyzed  in  [G22].  A  result  on  periodic  controls 
appears  in  [G21].  An  application  to  a  pursuit- 
evasion  problem  is  discussed  in  [G2, 3]. 

CONTROLLABILITY  AND  TIME 
OPTIMAL  CONTROL 

In  the  design  of  time-optimal  controls  difficulties 
with  high-order  systems  are  considerable  even  in 
the  linear  time-invariant  problems.  A  simplified 
design  procedure  has  been  developed  in  [HI,  2, 3]. 
The  discussion  here  is  based  on  [H2],  where  also 
the  following  controllability  result  is  obtained.  The 
use  of  (10)  and 

£  -  x-/xA„  An~l  ij  +  0(n2)  (57) 

transforms  (6),  (7)  into 

£  -  [/t-r  OM]  f +  [B+  0(M)] «,  (58) 

M  -  [An  +  0(h)]  i?  +  [i?, + 0(h)]  u,  (59) 

whereof  ■  *  Ajj,  B  38  Bi  —  An  An 

see  (9). 

It  follows  from  (58),  (59)  that  for  h  small  the 
controllability  of  the  reduced  and  the  boundary 
layer  systems,  that  is  of  the  pairs  A,  B  and  An,  Bt, 
implies  the  controllability  of  the  original  system 
(6),  (7). 

In  the  time-optimal  control  problem  a  control 
u,  subject  to  constraint  |u<|<  1,  i  —  1,  ...,r,  is  to 
transfer  the  state  of  (6),  (7)  from  x(0)  «•  x°,  z( 0)  -  z° 
to  x(T)  ”  0,  z(T)  -  0  in  minimum  time  T.  Equi¬ 
valently  the  problem  can  be  solved  in  terms  of  £ 
and  T).  A  control  steering  £,  tj  to  zero  in  minimum 
time  is  of  the  form 

u  ■  -sgn  {.5'exp  [A'(T -  t)]p 

+  Bt'  txp(-Aua)q),  (60) 

where  a  is  as  in  (21),  p  and  q  are  constant  vectors 
and  0(p.)  terms  have  been  neglected.  When  the 
eigenvalues  of  Au  all  have  negative  real  parts,  the 
term  depending  on  a  is  significant  only  near  T.  For 
some  <t*<0  and  0< /<7" +h°*  the  control  (60) 
can  be  approximated  by 

H~-sgn{B'exp[A'(T-t)]p},  (61) 


which  is  interpreted  as  a  time-optimal  control  for 
the  reduced  system  (9),  steering  X  to  zero.  For 
T+h°* <‘^T  the  control  (60)  is  approximated 
by 

u„  -  -  sgn  {B'p+ Bt'  exp  ( -  Au  o)q).  (62) 

We  note  from  (8)  that,  after  the  last  switching  of  u, 
z  may  be  far  from  the  origin  and  the  boundary  layer 
control  u„  is  needed  to  correct  this  error. 

This  separation  of  slow  and  fast  switchings  was 
first  analyzed  for  single-input  systems  in  [HI],  and 
then  generalized  in  [H2].  A  special  case  when  (7)  is 
due  to  actuator  dynamics  is  discussed  in  [H3],  An 
iterative  method  based  on  these  results  is  developed 
in  [H4], 

FILTERING  AND  SMOOTHING 

Results  on  singular  perturbation  of  linear- 
quadratic  regulator  problems  should  have  their 
counterparts  in  the  linear-quadratic-Gaussian 
filtering  and  smoothing  problems.  Preliminary 
investigations  along  this  line  have  been  reported  in 
[11,3-6].  The  analysis  in  [16]  shows  that  the 
duality  is  not  complete  and  the  singularly  perturbed 
filtering  and  smoothing  problems  require  separate 
treatment  and  cautious  interpretation.  The 
analysis  is  more  complicated  since  the  white  noise 
input  process  u  in  (58),  (59)  ’fluctuates’  faster  than 
the  fast  part  rj  of  the  state  no  matter  how  small 
H>  0  is.  In  the  limit,  tj  becomes  a  white  noise 
process  whose  covariance  is  the  same  as  the 
covariance  of  the  reduced  solution  rj,  and  the 
integral  error  covariance  of  r)(t)-ij(t)  tends  to  zero. 
Thus,  as  an  input  to  a  slow  system,  rj(t)  can  replace 
■q(t),  but  not  as  an  approximation  for  each  t. 
Pursuing  such  considerations  it  is  shown  in  [16] 
that  a  filtering  (or  smoothing)  problem  for  the 
system  (6),  (7)  can  be  obtained  by  solving  two 
lower  order  problems  in  separate  time  scales. 

An  example  given  in  [12]  indicates  that  deter¬ 
ministic  observers  also  can  be  approached  as 
singular  perturbations.  Control  problems  with 
small  noise  are  treated  in  [17, 8]. 

CHEAP  CONTROL  AND  SINGULAR  ARCS 

In  singular  perturbation  problems  considered  so 
far  a  small  parameter  h  multiplies  derivatives  and 
the  differential  order  is  reduced  when  h  “  0. 
Another  sign  of  singular  perturbation  phenomena 
is  a  characteristic  lowering  of  dimensionality  for 
the  limiting  problem,  such  as  in  limit  approaches  to 
singular  optimal  controls  [J 1  ].  An  example  of  these 
problems  is 

x  m  Ax+Bu,  *(0)  m  X®,  (63) 

/  »  j  J0  (*'  Qx+h*u'  &u)  fit.  (64) 
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where  /  is  to  be  minimized  for  p  small.  In  [L2] 
analogous  problems  for  systems  governed  by  partial 
differential  equations  are  called  ‘cheap  control’ 
problems  since  the  cost  of  the  control  u  is  cheap 
relative  to  that  of  the  state  x  (for  2  >0).  Other 
applications  include  study  of  limiting  possibilities 
for  regulators  and  filters  [J2, 5;  18]. 

When  ft,  —  0,  the  resulting  problem  is  a  well- 
known  singular  problem  [J3]  whose  solution 
satisfies  the  singular  arc  condition 

ff  Ai-0  (65) 

for  t>  0  and  the  appropriate  Riccati  gain  Kq. 
Motion  is  thereby  restricted  to  a  manifold  of 
dimension  at  most  n-r.  By  obtaining  the  asymp¬ 
totic  solution  of  (63),  (64)  as  p-*0,  we  show  how 
this  reduction  in  order  comes  about  and,  simul¬ 
taneously,  discover  the  nature  of  the  initial  control 
impulse.  For  p>0,  the  feedback  control  is 

u~-\r~'B'Kx,  (66) 

where  K>  0  satisfies  the  singularly  perturbed 
problem 

+  A'  K+  Q)  -  KBR-1  B' K, 

K(T)  -  0.  (67) 

The  limiting  solution  K0  of  (67)  within  (0,71 
satisfies  the  singular  arc  condition  (65).  An 
asymptotic  solution  of  (67)  is  complicated  and 
considerably  different,  however,  in  a  hierarchy  of 
cases:  Case  l  where  B'QB> 0,  Case  2  where 
B’QB-0  and  B1'QBX> 0  for  B^-AB-6.  This 
reflects  the  situation  for  the  singular  arc  problem 
[J3,4]  where  the  initial  optimal  control  successively 
becomes  increasingly  impulsive  and  the  singular  arc 
increasingly  restrictive.  A  singular  perturbation 
analysis  in  [J6— 10]  reveals  the  detailed  structure  of 
these  phenomena.  Its  use  for  numerical  solution  of 
ill-conditioned  Riccati  equation  is  discussed  in 

[Ill]. 

TIME-DELAY  SYSTEMS 

The  difficulties  incumbent  with  control  systems 
having  time  delays  have  motivated  various  approxi¬ 
mations.  When  the  delay  is  small,  it  is  often 
neglected  and  a  tractable  ‘nominal’  problem  is 
solved.  Such  design  procedures  can  be  justified  in 
terms  of  singular  perturbation  methods.  Boundary 
layer  phenomena  do  occur,  although  they  are  not  of 
lowest  order  importance.  Interesting  and  significant 
extensions  are  to  problems  with  both  small  para¬ 
meters  multiplying  derivatives  and  small  delays. 
Discussions  with  applications  to  nuclear  reactor 
models  occur  in  [K.l-4],  In  [K5]  a  method  is 
proposed  replacing  several  small  time  constants  by 
a  single  time  delay. 


DISTRIBUTED  PARAMETER  SYSTEMS 

From  the  results  of  [LI,  3]  it  can  be  expected  that 
the  singular  perturbation  techniques  will  be  among 
the  main  tools  for  asymptotic  analysts  and  design  of 
optimal  control  of  distributed  parameter  systems. 
Several  generalizations  of  the  finite  dimensional 
linear-quadratic  problems  are  available.  In 
particular,  a  distributed  parameter  analog  of  the 
method  [F5.7]  is  developed  in  [L3]  for  systems 
described  by  singularly  perturbed  parabolic  differ¬ 
ential  equations. 

CONCLUSION 

It  seems  that,  instead  of  giving  a  short  summary 
of  solved  problems,  the  conclusion  of  a  survey  of  a 
new  direction  of  research  should  concentrate  on 
missing  links,  restrictive  assumptions  and  hints  of 
new  problems.  Starting  with  order  reduction  the 
need  for  a  systematic  modeling  procedure  to 
formulate  the  model  (1),  (2)  is  apparent.  Con¬ 
versely,  this  model  is  expected  to  interpret  other 
order  reduction  procedures  as  limit  processes.  In 
initial  and  boundary  value  problems,  controllability 
and  stabiiizability  studies  may  relax  the  restrictions 
of  stable  initial  and  final  manifolds.  Although 
optimal  regulators  seem  a  solved  problem,  there 
remains  a  desire  to  reduce  the  dimensionality  of  the 
feedback  matrix.  In  trajectory  optimization, 
restrictions  on  norms  of  boundary  layer  jumps 
should  be,  and  very  likely  can  be,  removed  for  a 
wider  class  of  Hamiltonian  systems.  The  only 
result  with  constrained  control  is  the  linear  time- 
optimai  control.  Various  generalizations  to  other 
bang-bang  controls  are  visible. 

In  addition  to  linear  regulators,  other  optimum 
feedback  design  problems  need  to  be  solved. 
Order  reduction  in  dynamic  programming  and 
Hamilton-Jacobi  optimization  approaches  would 
result  in  even  bigger  conceptual  and  computa¬ 
tional  simplifications.  Singularly  perturbed  filter¬ 
ing,  smoothing,  singular  arc,  distributed  systems 
and  time-delay  problems  require  further  explora¬ 
tion.  More  work  on  numerical  aspects  of  these 
problems  is  also  needed.  What  has  been  surveyed 
here  is  only  a  first  step. 
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Singular  Perturbation  and  Iterative 
Separation  of  Time  Scales* 

PETAR  V.  KOKOTOVIC,t  JOHN  J.  ALLEMONG.*  JAMES  R.  WINKELMAN§ 

and  JOE  H.  CHOWf 

Bastd  on  singular  perturbations  concepts,  an  iterative  method  for  separation  of  time 
scales  removes  inconsistencies  of  the  classical  quasi-steady-state  approach,  and  it 
systematically  improves  the  accuracy  of  lower  order  models. 

Key  Computation*!  method*;  time  tea  It  modeling;  tyttem  order  reduction:  iterttivt  methods; 

potter  system  simulation:  nonlinear  systems. 


AIM ract— This  tutorial  paper  presents  an  iterative  method  for 
the  separation  of  slow  itnd  fast  modes,  which  removes  the 
inconsistencies  of  the  classical  quasi->teady-*tait  approach 
and  systematically  improves  the  accuracy  of  (he  lower  order 
models,  (t  also  serves  as  a  self-contained  introduction  to 
singular  perturbations.  State  variable  reformulation  and  lime 
scale  identification  arc  discussed  and  illustrated  with  power 
system  examples.  A  correction  procedure  for  nonlinear  sys¬ 
tems  is  also  presented. 


NOTATION 
machine  damping 
machine  angle 

component  of  voltage  behind  transient  reactance 
due  to  quadrature  axis  flux  linkages  (not  with  the 
field  windings) 

component  of  voltage  behind  transient  reactance 
due  to  direct  axis  flux  linkages  (with  the  field 
windings) 

exciter  output  voltage 
machine  inertia  constant 
voltage  regulator  gain 
exciter  gain 

feedback  compensator  gain 
leakage  inductances 
self  inductances 
flux  linkages 
turns  ratios 

feedback  compensator  state 

transformer  resistances 

exciter  saturation 

voltage  regulator  time  constant 

open  circuit  direct  axis  tune  constant 

exciter  time  constant 

feedback  compensator  time  constant 
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open  circuit  quadrature  axis  lime  constant 
voltage  regulator  output 
machine  speed 

direct  axis  synchronous  reactance 
quadrature  axis  synchronous  reactance. 


1.  INTRODUCTION 

Realistic  models  of  large  scale  systems  involve 
interacting  dynamic  phenomena  of  widely  dif¬ 
ferent  speeds.  In  a  power  system  model,  for 
example,  voltage  and  frequency  transients  range 
from  intervals  of  seconds,  corresponding  to  gene¬ 
rator  voltage  regulator,  speed  governor  action 
and  shaft  energy  storage,  to  several  minutes, 
corresponding  to  load  voltage  regulator  action, 
prime  mover  fuel  transfer  times  and  thermal 
energy  storage  (Luini.  Schulz  and  Turner.  1975). 
Since  such  models  are  of  high  order  and  numeri¬ 
cally  stiff,  order  reduction  and  separation  of  time 
scales  are  often  made  using  aggregation,  modal 
analysis  and  similar  techniques  (Sandell  and  co- 
workers,  197S;  Undrill  and  Turner,  1971).  The 
underlying  assumption  is  that  during  the  fast 
transients  the  slow  variables  remain  constant  and 
that  by  the  time  their  changes  become  noticeable, 
the  fast  transients  have  already  reached  their 
quasi-steady-states  (‘qss').  Based  on  this  qss  as¬ 
sumption  and  experience,  the  state  variables  are 
divided  into  n  'slow'  states  x  and  m  fast'  states  :. 
that  is  the  full  scale  model  is 


f(x,:,t\ 

x(t0)«x° 

il 

G{x,z,  r). 

\2 

Then  the  only  states  used  for  short  term  studies 
are  disregarding  (1)  and  considering  the  states 
r  as  constant  parameters.  In  long  term  studies 
the  only  states  used  are  x  and  the  differential 
equations  for  :  are  reduced  to  algebraic  or 
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transcendental  equations  by  formally  setting 
i-  0.  The  qss  model  is  thus 

^ ^,.0  *('o)-*°  (3) 

0-G(x„i„t).  (4) 

Examples  of  power  system  models  derived  in 
such  a  fashion  are  many,  as  illustrated  in  Alder 
and  Nolan  (1976).  An  inconsistency  of  this  classi¬ 
cal  qss  approach  is  the  requirement  that  j,  equal 
a  constant,  as  implied  by  is  violated  by 

(4)  which  defines  as  a  time  varying  quantity. 
Furthermore,  the  initial  condition  for  r  had  to  be 
dropped  in  (4),  since  there  is  no  freedom  to 
satisfy  it.  If  a  qss  model  fails  to  provide  a  good 
approximation  of  the  actual  solution  x(t)  and 
;(r),  there  is  no  provision  for  improving  the 
approximation. 

This  tutorial  paper  presents  an  iterative  scheme 
for  the  separation  of  slow  and  fast  modes  which 
removes  the  inconsistencies  of  the  classical  qss 
approach  and  systematically  improves  the  ac¬ 
curacy  of  the  lower  order  models.  It  modifies  the 
qss  assumption  into  the  multi-time  scale  property 
of  singularly  perturbed  systems  (Kokotovic, 
O'Malley  and  Sannuti,  1976;  Chow,  Allemong 
and  Kokotovic,  1973)  and  applies  the  modified 
qss  assumption  at  each  iteration  step  to  the 
model  obtained  from  the  previous  step.  The 
accuracy  of  the  models  for  the  slow  and  the  fast 
modes  is  improved  at  each  step  and  they  are 
further  separated  from  each  other.  The  iterations 
are  related  to.  but  simpler  to  interpret  than 
standard  asymptotic  expansion  methods 
(Hoppensteadt,  1974;  O’Malley,  1974).  The  suc¬ 
cessive  use  of  the  modified  qss  assumption  can  be 
followed  without  any  background  in  singular 
perturbation  theory.  The  iterations  offer  more 
freedom  to  select  various,  possibly  nonuniform, 
combinations  of  correction  terms.  Finally,  the 
tutorial  use  of  the  classical  qss  assumption  as  an 
introduction  to  singular  perturbations  clarifies 
the  relationship  between  the  classical  model  re¬ 
duction  and  the  singular  perturbations  method. 
The  classical  approach  can  now  be  justified  and 
improved  to  any  degree  of  accuracy. 

2.  SINGULAR  PERTURBATIONS  AND 
TIME  SCALES 

Assuming  that  r  is  properly  scaled  for  the  slow 
phenomena,  let  us  introduce  a  new  time  variable 
r  and  scale  it  for  the  fast  phenomena.  For 
example,  if  t  is  in  minutes,  r  can  be  in  seconds. 
The  ratio  of  the  time  scales,  in  this  case  1/60.  is 
in  general  a  small  positive  parameter  r..  This 
parameter  will  be  the  main  tool  for  our  asymp¬ 


totic  analysis.  Using  e  the  new  time  variable  t  is 
defined  by 

xm{t  —  t')/e  (5) 

and  its  initial  instant  t»0  is  chosen  to  cor¬ 
respond  to  a  particular  instant  i'  in  r  time  scale. 

The  wider  the  separation  of  the  time  scales, 
such  as  seconds  and  hours,  the  smaller  t  will  be. 
On  the  other  hand,  the  smaller  t  is,  the  larger  t 
will  be  for  a  given  (r  —  c')  interval.  In  the  limit  as 
-(-•0  even  a  short  interval  in  t  is  ‘stretched’  to  an 
inftnite  interval  in  r.  When  r  is  sufficiently  targe, 
the  fast  phenomena  have  adequate  time  to  reach 
their  steady-states.  This,  however,  does  not  con¬ 
tradict  the  assumption  that  (r  —  r')  is  sufficiently 
short  to  consider  the  stow  variables  as  constants. 
Thus,  the  limit  of  e-*0  is  equivalent  to  the  qss 
assumption,  but  without  its  inconsistencies. 

A  more  difficult  task  is  to  reformulate  the 
model  (1),  (2)  to  incorporate  the  scaling  (S).  If  it 
is  known  that  the  dynamics  of  the  states  r  are  1/s 
times  faster  than  x,  then  i  is  about  i  s  times 
larger  than  x  and  G  can  be  rescaled  as 

g-sG  (6) 

such  that  /  and  g  are  of  the  same  order  of 
magnitude.  The  model  (1),  (2)  then  becomes 


mf(x,:.t)  x(r0)«.x° 

(7) 

-g(.x,r.r)  i(f0)«r#. 

(8) 

The  above  qualitative  reasoning  is  based  on  some 
empirical  estimates  of  d.x/dt  and  dr/dr.  When  this 
information  is  not  available,  then  physical  para¬ 
meters  such  as  time  constants,  loop  gains  and 
energy  storage  constants  (masses,  inductances, 
etc.)  are  examined  to  determine  which  states  are 
slow  and  which  are  fast.  Not  every  choice  of  state 
variables  will  be  separable  in  this  sense.  Where 
separable,  a  model  (7).  t8)  will  be  obtained  by 
expressing  the  small  time  constants  and  the  in¬ 
verses  of  the  high  gain  coefficients  as  multiples  of 
a  single  small  parameter  e  [see  Section  3  and  the 
companion  paper  (Winkelman  and  co-workers. 
1980)]. 

In  the  limit  k— 0.  the  model  (7),  |S).  being  in 
the  r  time  scale,  defines  the  quasi-steady-states 
x.U).  r,(t)  as 

Xm('V-V)  x,(t0)«.v°  (9) 

Qt 

0-g(x„  (10) 
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Although  this  is  the  same  qss  model  (3),  (4),  its 
origin  and  meaning  are  different.  The  crucial 
difference  is  that  dc.'dr^O  as  required  by  (10)  is 
not  contradicted  by  e(dzjdt)—Q  which  is  now 
due  to  e  ■  0.  and  not  dzjdt « 0.  To  obtain  the  fast 
parts  of  v  and  z  we  rewrite  (7).  (8)  in  the  fast 
time  scale  r 


d.t 

~-e/(x,r,t'+«) 

(ID 

dz  ,  ,  ^ 

—  »$(.*,  if' +«) 

(12) 

and  again  examine  the  limit  as  e-*0.  Then 
dx/dr»0,  that  is  .v  is  constant  in  the  fast  time 
scale.  This  implies  that  os  t— 0  the  only  fast 
variations  are  the  deviations  of  r  from  its  quasi- 
steady-state  Denoting  them  by  zf»z-z,  and 
letting  e*Q  in  (11),  (12),  we  obtain 


*21 

dr 


-g(.x9,.-?  +  r/<r).r0),  r,(0)-:°  — 2?.  (13) 


system.  Furthermore,  for  lightly  damped  oscil¬ 
latory  systems,  the  validity  of  the  approximation 
(14),  (IS)  is  only  up  to  a  finite  time  t  which 
depends  on  the  accuracy  of  the  high  frequency 
being  approximated. 

While  the  full  order  models  (7),  (8)  and  (11), 
(12)  are  exact,  the  separated  lower  order  models 
(9),  (10)  and  (13)  are  in  error  because  they 
assume  t“0,  instead  of  the  actual  e>0.  This 
parameter  change  is  called  ‘singular’  and  it  re¬ 
sults  in  an  inherent  perturbation  in  model  order. 
The  approximation  (14),  (IS)  can  now  be  im¬ 
proved  by  constructing  asymptotic  expansions  in 
e.  It  is  crucial  that  each  expansion  term  is 
calculated  at  0,  retaining  the  advantage  of 
having  separate  lower  order  models.  The  stan¬ 
dard  expansion  techniques  are  described  in 
Hoppensteadt  (1974)  and  O'Malley  (1974).  Our 
iterative  technique  is  presented  in  Section  4, 
illustrated  with  a  power  system  example  in 
Section  5  and  extended  to  a  class  of  nonlinear 
systems  in  Section  6. 


The  fixed  instant  c'  has  been  chosen  to  be  t0  and 
hence  the  model  constants  are  r0,  x°,  r?«r,(f0), 
which  is  suitable  for  the  fast  phenomena  occur¬ 
ring  near  r0. 

Using  (9),  (10)  as  the  slow  model  and  (13)  as 
the  fast  model  one  expects  to  approximate  x  and  : 
by 

x(f)a.x,(r)  (14) 

z(t)Sr,(r)  +  i/^^j  (15) 

where  :f(z)  is  expressed  in  the  t  time  scale.  When 
is  such  an  approximation  valid?  How  can  it  be 
further  improved?  Singular  perturbations  ad¬ 
dresses  these  issues  much  better  than  other  model 
simplification  methods.  The  tool  at  hand,  not 
present  in  other  methods,  is  the  scaling  para¬ 
meter  e. 

Recent  results  by  Chow,  Allemong  and 
Kokotovic  (1978)  show  that  systems  with  lightly 
damped  high  frequency  oscillatory  modes  can 
also  be  expressed  in  the  form  of  (7),  (8).  The 
reduction  procedure  (9H15)  and  the  iterative 
separation  method  discussed  in  Section  4  also 
hold  for  these  systems.  However,  the  interpre¬ 
tations  of  the  reduction  process  for  these  two 
types  of  systems  are  quite  different.  With  well 
damped  fast  modes,  the  state  z  rapidly  reaches  its 
quasi-steady-state  r,.  When  the  state  exhibits 
high  frequency  oscillations,  the  state  x  is  approxi¬ 
mated  by  the  slow  subsystem  (9),  ( 10)  due  to  the 
‘averaging’  or  filtering  effect  of  the  slow  sub¬ 


3.  SEPARABLE  AND  MIXED  STATES 

Before  proceeding  to  the  iterative  separation  of 
time  scales,  we  illustrate  the  state  separation 
problem  by  two  elementary  examples.  In  the 
IEEE  type  1  voltage  regulator  (IEEE  Committee 
Report,  1968)  commonly  used  state  variables  are 
separable,  that  is  the  fast  parts  of  some  states  are 
small  compared  with  their  slow  pans.  The  model 
(7),  (8)  can  be  obtained  without  redefinition  of 
the  state  variables.  On  the  other  hand  the  com¬ 
monly  used  state  variables  in  a  transformer  mo¬ 
del  are  not  separable.  In  this  ‘mixed’  case  another 
choice  of  state  variables  exists  for  which  the 
model  is  in  the  form  (7),  (8). 

Voltage  regulator.  We  use  the  standard  model 
in  Fig.  1  with  the  exciter  saturation  SclEf4) 
* Aa.expCB^/J  retained  but  limit  type  non- 
linearities  neglected.  The  numerical  values  are 
given  in  Table  1.  The  feedback  compensator  is 
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TaKJ  1.  Vo*. TAG*  UOUUTO*  CONSTANTS 

ta  -  ao6* 

x,  -  -0.0*45 

*  dr 

Tt  m  as* 

K,  •  0.16 

T,m  t.0* 

A^r  -  0.001123 

*4 -HO 

r-  A3063 

*  dr 

.2Cx,-0 I0445«r1-«5e(il)] 
j^[ai6U-s,)-r,+AP]- 


(22) 

(23) 


represented  by  two  parallel  paths  in  order  to 
exhibit  Ay.  The  state  equations  are 


*  "T,L7> 


(*/ 


-£y,)-£+AF 


(16) 


^-Ttv*-K'E'‘~St{E"):  (17) 


T, 


(18) 


where  PW—  V.  To  separate  the  states  let  us 
identify  the  fast  and  slow  loops  in  Fig.  1.  Since 
Ta  is  much  smaller  than  Tc  and  Tr,  the  amplifier 
loop  is  fast  and  its  state  Vk  will  have  a  non- 
negligible  fast  part.  The  nature  of  Ef4  is  less 
obvious.  If  it  has  a  fast  part,  it  would  not  pass 
through  the  low  pass  Ay-path  (7>  is  large),  but  it 
would  pass  through  the  parallel  path.  We  there¬ 
fore  disregard  the  Ay-path  and  examine  the  re¬ 
maining  system.  Using  K'g  as  some  linearized 
equivalent  of  the  exciter  gain,  we  see  that  the 
loop  gain  KATr/KtKr  is  high  because  KA  is  large 
and  K’gKf  is  small.  The  conclusion  is  that  £r4  as 
a  signal  in  a  high  gain  loop  will  have  a  fast  part. 
The  remaining  state  Ay  is  a  candidate  for  a  slow 
state. 

Our  next  step  is  to  examine  whether  this 
choice  of  state  variables  can  be  scaled  for  (7),  (8). 
Since  the  fast  phenomena  are  caused  by  the 
smallness  of  1/A,, -0.04  and  TA  -  0.06,  we  take 
r-0.04,  that  is 

-j-«e  and  TA - l.5c.  (19) 


Applying  the  reduction  procedure  (9H15),  the 
slow  model  (9),  1 10)  is 


dr 

*».■ 


0.16 


AK 


•*»+ 


A/ 

0.16 


ra«0 


(24) 


and  the  fast  model  is 


Hr 


tel} 

dr 


-1 

1.5 


(016-ty  +  i2y 


).  (25) 


To  get  an  idea  how  this  approximates  the  full 
scale  model,  we  linearize  (21).  (22),  (23)  and 
compare  its  eigenvalues  with  those  of  (24)  and 
(25)  multiplied  by  l/'e*25.  They  compare  very 
closely  as  0.00916  to  0,  and  -8.80^/8.45  to 
—  8.33  i/7.99. 

Transformer.  In  the  coupled  circuit  in  Fig.  2 


Fig.  2.  Transformer  model. 


the  ratio  of  leakage  inductances  /,  and  the 
self  inductances  L,.  Lz  is  assumed  to  be  the  same 
small  parameter 


In  addition  to  the  time  scaling,  the  states  must  be 
scaled  to  allow  a  meaningful  limit  as  t—0.  It  is 
apparent  from  Fig.  I  that  Vg—  x  if  KA—  x,  that 
is  if  £— *0.  Hence  we  will  use  zVR  as  a  fast  state 
variable.  With 


Using  the  flux  linkages 


Ay»X,  £yj«C,,  VR  m  r2 


(20) 


and  with  the  given  numerical  values,  the  voltage 
regulator  model  in  the  form  (7),  (8)  is 


.V, 


d.x 
—  1 
d  t 


X,  «<l  +/!)£,/,  -—  Lji 

.  V  1 


,V, 

'-im  -Trf-t'i  +  11 
•'  l 


(27) 


» - .  -x 


(2D 


as  the  state  variables  and  eliminating  » , .  i,  from 
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(27)  using  equations 


as  the  difference  between  r  and  t, 


d;.,  _  <li, 

—  +0  -jZm-Riij  (28) 


we  obtain  the  model 


d/.,  v  1  +e  . 
6  dr  "  *  T, 


e— » 


dr 


1 

hTi 


ft 

(29) 

yiTe  . 
r2 

(30) 

*LX/Rt,  7j 

■  L2/B2. 

where  It  -  T:.V,/T,»V.t 
The  small  parameter  e»2/i-*-jtJ  multiplies  both 
derivatives,  and  hence  both  and  /.,  are  fast, 
that  is  when  we.  for  example,  take  -  - 1. 

•0.  i  »0L  both  derivatives  will  tend  to  infinity  if 
e— 0.  However  the  system  matrix  becomes  sin¬ 
gular  indicating  the  possibility  of  a  hidden  siow 
phenomenon.  Since  both  and  /.2  are  fast,  we 
form  the  slow  state  by  subtracting  out  the  fast 
phenomena  in  and  /.2.  This  is  equivalent  to 
defining  a  state  x  as  a  linear  combination  of 
and  such  that  the  derivative  of  .x  will  not  be 
multiplied  by  s.  In  this  case,  an  appropriate 
transformation  is  xm/^—lu,,  and  the  variable 
is  kept  as  the  fast  variable.  Then  (29), 
(30)  becomes 


dx 

—  i 

dr 

dr 

:dr" 


1  h/l  l\ 
2TlX“2\Tl*Tl)S*t 

1  /ll  e  \ 

/.TtA"U  T1+2tJ' 


(31) 

(32) 


7i«r-t-0*‘Cx  (35) 

which  transforms  (33X  (34)  into 

—  M -BD~  'Ox  +  Btf,  *4,x  +  B/f,  (36) 

sift  ■ef)'lC/4|X-MD+eZ)“lCB)>h  ■C|X  +  01»f1. 

(37) 

This  is  a  model  of  the  type  (7),  (8)  with 
playing  the  role  of  r.  The  crucial  difference  is 
however  in  the  weaker  presence  of  x  in  the  rjl 
equations  where  C,  is  0(e)-*  The  qss  of 
obtained  from  O-^.  +  Dr'C^x,  is  only  0(e), 
that  is,  >7,  is  predominantly  fast.  Continuing  this 
process  we  introduce 


+Or'C,x  (38) 

as  the  error  due  to  the  qss  assumption  Eif,t»0 


and  substitute  (38)  into  1 36).  (37). 
step  k  times  with 

Repeating  this 

Ik  m  Ik  -  1  +  &k  -  1  Ck  -  1  x 

fJom-  (39 ) 

we  end  up  with  the  system 

X  rn  4.  Blf„ 

(40) 

aikmCkx  +  Dkt ik 

(41) 

whose  matrices  are  defined  by 

—  BDliJlCk~l 

A0-A  (42) 

where  v  (l  -re)  is  approximated  by  1  +e/2.  This  is 
now  a  model  of  the  type  (7),  (8)  having  the 
physically  meaningful  slow  model  dxBdt- 
-xB(r,  +  r2)  +  e  for  the  flux  linkage  of  an  ideal 
transformer  and  the  fast  model  dr^/dt*  ~{T~l 
+  Tj 1  );f,  representing  the  flux  leakage. 


Cj*ti)k.iC|.[/l|  C0»C  (4a) 
0»-0II-l+e0;.llCk.iB  00-0.  (44) 

Again  Ck  has  been  reduced,  this  time  to  Ole*).  To 
recover  z  from  <jk  and  x  we  observe  from  (39) 
that 


*.  iterative  separation  of 

TIME  SCALES 

As  a  special  case  of  (7),  (8)  we  consider  a  linear 
system 

xmAx  +  Bz  x(f0)»x°  (33) 

zi  «•  Cx  -r  Dz  (34) 

where  d.dr  is  denoted  by  a  dot  and  D~ 1  is 
assumed  to  exist.  The  qss  assumption  ed,« 0,  that 
is  0«rf-rD" lCxf,  yields  z,«-0*lCxt.  The  true 
x,  z  will  differ  from  x„  z,  mainly  by  their  fast 
parts.  To  find  the  fast  part  of  r  we  introduce  rj, 


I  (li-'Ii-i)-'I»-r-(l  Df-l,C(.,)x. 

i  •  1  \l  •  1  / 

(45) 

Block  diagram  representations  of  the  iterations 
are  given  in  Fig.  3.  The  qss  model  is  indicated  in 
thick  lines.  The  speed  of  integration  in  the  fast 
loop  is  large  due  to  its  high  gain  1/e.  The  input 
from  x  into  each  successive  fast  model  is  weaker. 
In  the  limit  i  k  »  x )  the  model  becomes  the  fast- 
slow  cascade  in  which  A  t  contains  all  the  slow 


*A  vector  or  mum  function  #(«)  of  a  positive  scalar  c  is 
said  to  be  Ole*  I  if  there  exist  positive  constants  c  and  c*  such 
that  |*(el|Srt*  for  ail  tit*. 
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Fig.  3.  Block  diagram  models. 

modes  and  DJe  all  the  fast  modes.  Using  (42), 
(43)  and  (44)  we  can  determine  AX~A-BD~'C 
+0(e)  and  0»»0-(-0(e),  that  is,  the  slow  and 
the  fast  subsystem  matrices  which  would  have 
been  obtained  using  (9).  (10)  and  (13)  as  O(s) 
approximations  of  Ax  and  D„.  Note  that  Ar 
and  Dx  are  obtained  in  terms  of  the  original 
subsystem  matrices  without  ill-conditioned  modal 
transformations.  Another  practical  advantage 
over  the  modal  method  is  that  the  physical 
meaning  of  the  original  state  variables  is  pre¬ 
served.  From  (45),  the  definition  of  x  remains  the 
same,  while  the  new  state  variable  if*  has  the 
same  meaning  as  r. 

After  k  iterations  the  model  (40),  (41)  still  has 
the  full  fast  input  Bnk  into  the  slow  subsystem 
which  we  now  want  to  reduce.  Expressing  >jk 
from  (41;  in  terms  of  r)k  and  x  and  substituting 
into  (40) 

x-tBDk'rik»(Ak- BD[ 1 CJ.x i  Ak . , x  (46 ) 
suggests 

».x-eBDk  'rj„  (47) 

as  the  slow  part  of  .x.  The  slow  subsystem  then 
becomes 

4 1  **  +  Bulk-  (48 ) 

Since  Bhl  is  0(s)  the  fast  input  has  been  reduced. 


Next  we  define  as  the  slow  part  of  etc,  that 
is  we  construct  the  iterations 

'ik  <Jo  -  x.  H9) 

where 


1  “  “  BkjDkj  1  Ck 

-4*0  “ 

(50j 

BkJ  ,  \ m  tAki  *  i  Bk,Dkj 1 

Bko~B 

(51) 

&kj*  1  ”  Dkj  +  tCkBkftk)  1 

&ko  m  Bk. 

(52) 

The  weakening  of  the  fast  input  has  been  accom¬ 
plished  since  after  each  iteration  Bkj  is  reduced  by 
an  order  of  t  and  tends  to  zero  as  /-*r o.  In  other 
words  the  slow  and  the  fast  subsystems  of  the 
resulting  system 

h  (53) 

frit  o)-')?  (54) 

are  only  weakly  coupled  because  Bkj  is  0(eJ)  and 
Ck  is  0(6*).  It  is  also  easily  seen  that  Ak/,  DkJ  are 
0(e**/)  approximations  of  Ax,  Dx. 

To  recover  .v  from  ^  and  qk  we  observe  from 
(47)  that 

I  ($<-&- 1)- *>-•«- -ef  I  ^u-i^u-t'j'T*- 

i-i  \i-i  1 

(55) 

Thus  the  slow  variable  ;;  is  the  dominant  part  of 
x.  whose  fast  part  is  0(e).  It  is  of  practical 
importance  that  has  the  same  physical  mean¬ 
ing  as  .v. 

Remark.  Observe  that  the  recursions  remain 
the  same  if  we  use  C,e  and  D/c  instead  of  C  and 
D.  This  means  that  e,  which  is  cructal  in  the 
asymptotic  analysis  of  validity  and  convergence, 
does  not  have  to  be  explicitly  identified  in  the 
iterations. 

In  conclusion  our  objective  to  reduce  a  system 
with  coupled  slow  and  fast  parts  has  been  met.  In 
the  transformed  system  (53).  (54)  the  coupling 
terms  Bk,  and  Ck  are  weak  and  can  be  neglected. 
Instead  of  the  original  full  order  system  (53).  (54) 
we  will  use  the  separate  lower  order  subsystems 

Z,-Ak,ZruiK*Dk/\k  (56) 

with  the  initial  value  iff  obtained  from  ,x°.  r°  via 
(45)  and  obtained  from  .x°  and  t/k  via  (55). 
The  simulation  of  »jk  can  be  performed  in  the  fast 
time  scale  r. 

The  error  Z,(t)-Z,(t)  is  0(^1  while  the  error 
if»(t)-(Tk(f)  «  0(*M.  Using  J,(r).  ift(f)  we  obtain 
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the  corresponding  approximation  of  x(r),  i(r)  by 
evaluating  .*f(r)  from  (55)  and  f(r)  from  (45).  The 
error  x(r)-.f(r)  is  01^)  where  i-min(;,fc  +  l) 
while  the  error  r(r)  —  I(t)  is  0(t?)  where  I- 
min  (j,  k).  In  long  term  or  short  term  studies  a 
further  simplification  would  be  to  keep  only  one 
of  the  two  models  (56).  In  general  we  need  to 
compute  four  matrices  Akj,DkJ  and  the  sums  in 
(45)  and  (55).  They  can  be  generated  by  (42M44) 
and  (50M52). 

An  alternative  algorithm  is  presented  in 
Kokotovic  (1975)  and  is  motivated  by  (45)  and 
(55).  Substitution  of  if-r+Lx  into  (34)  yields 

ai-Mx  +  (D+tLB)n  (57) 

where  \t~C-DL+&L(A-BL).  To  completely 
decouple  x  from  >i  in  (57),  we  choose  L  such  that 
A/-0.  The  expression  M  -0  rewritten  as  L« 
D~'C+eD~lL(.A  —  BL)  suggests  that  L  can  be 
solved  for  iteratively  as 

Lk.l*D~lC+eD~iLk(A-BLk) 

where  Lk~D~xC.  The  system  (33).  (34)  aficr  k 
L-iterations  has  the  form  (40),  (41),  where  the 
matrices  are  now  defined  as  Ak»A  —  BLk,  Ck — 
C - LkAk,  and  Dk~ D  +  LkB.  Note  that  as 
fc— x,  L»„  t  converges  to  L  when  e  is  sufficiently 
smalL 

Similarly,  substitution  of  into  (41) 

yields 

+  (58) 

and  we  set  N*‘B-HD+e(Ak-HCk)H ~Q  to  de¬ 
couple  rjk  from  (J.  Rearranging  the  expression 
,V»0  we  obtain 

H~BD{x+e(Ak-HCk  )HD »* 1 


Some  other  aspects  of  computing  Akl,  Dki  are 
given  in  Anderson  (1978). 

5.  AN  ILLUSTRATIVE  APPLICATION 

In  the  companion  paper  (Winkelman  and  co¬ 
workers,  1980)  a  systematic  separation  procedure 
using  the  iterative  scheme  is  proposed  and  ap¬ 
plied  to  the  two-time-scale  and  four-time-scale 
investigations  of  a  20th  order  model  of  a  three- 
machine  power  system.  Here  we  analyze  a  sev¬ 
enth  order  model  of  the  single  machine-infinite 
bus  system  in  Fig.  4.  A  five  cycle  3  phase  fault  is 


3 
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Fig.  4.  Single  machine — infinite  but  system  IAVR  is  the 
voltage  regulator  from  Fig.  1). 

applied  on  circuit  *a’  close  to  bus  2.  and  is 
cleared  by  opening  circuit  ‘a’.  This  example  will 
illustrate  some  features  of  the  separation  pro¬ 
cedure  and  introduce  the  time  scales  to  form  a 
basis  for  the  analysis  of  the  three  machine  system 
studied  in  the  companion  paper.  The  block  AFR 
in  Fig.  4  is  the  voltage  regulator  described  in 
Section  3  and  its  model  (16),  (17),  (18)  will  be 
retained  with  the  generator  terminal  voltage  V 
defined  by 

a2  V2  -  (a  - 1  )2 {ek  +  e/) + 2(a  - 1 ) 

x  («icos<5  —  e'ks\n5)V  +  V2  (59) 

where  a -(XT)*1  and  Y  is  the  admittance  of  the 
transmission  line.  The  four  additional  state 
equations 


and  solve  for  H  iteratively  as 

ff*/- imBDk  1  +-s(A»  —  HkjCk)HkjDk  1 

where  Hki»BDC '■  The  system  (40),  (4()  after 
; //-iterations  has  the  form  (53).  (54)  where  the 
new  expressions  for  the  matrices  are  Ati  — A* 
-HklCk,  BkjmB- HklDk  +■  AklHki  and  Dki»Dk 
*CkHki. 

The  L-  and  //-iterations  avdid  repeated  matrix 
inversions  of  Dk  and  Dkj  which  are  required  by 
the  iterations  (39)  and  (49).  The  development  of 
(39).  (40)  complements  the  L-.  //-iterations  by 
showing  that  L  and  H  are  obtained  from  a 
succession  of  qss  assumptions.  In  the  compu¬ 
tation  of  Ak,,  Dkj,  we  will  use  the  L-.  //-iterations. 


*  r«,(-ci+(.Vg-.Y')n«; 

-(*,-*')  min  (60) 

1 

'‘"r^iiX'-xtfvcosS 

-[im.y.-.yt]*,;  *6i) 

<5  —  377(<y—  1)  l62l 

—  -  D(a»—  1 ) 

co 

—  Y  Videos  sin  <5)1  (63) 
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describe  the  flux  linkage  decay  transients  in  the 
direct  ( d )  and  the  quadrature  (q)  axes  (60),  (61) 
and  the  mechanical  transient  by  the  swing  equa¬ 
tions  (62),  (63).  The  numerical  values  in  Table  2 
are  typical.  It  should  be  noted  that  in  this 
problem  formulation  the  quadrature  axis  leads 
the  direct  axis. 


Tasle  2.  Synchronous  machine  data 


H 

•  5.0* 

X,  -0.25  pu 

D 

•  2.0  pu 

r„  -5.o* 

x4 

-l.2pu 

r„  -o.5» 

x, 

•  1.0  pu 

X.  -0.01  pu 

X ■ 

•  0.25  pu 

X,  -0.01  pu 

To  determine  the  fast  and  slow  states  we  first 
note  that  the  earlier  reason  for  VK  and  Efd  to  be 
fast  remains  valid  in  this  enlarged  system.  The 
linearized  swing  equations  (62),  (63),  with  all  the 
variables  constant  except  for  <5  and  oj,  show  a 
typical  swing  frequency  of  about  1.4  Hz.  Hence 
both  d  and  <a  will  be  fast.  Finally  for  the  flux 
linkage  equations  we  note  that  the  quadrature 
axis  has  a  much  smaller  time  constant  (0.5  s) 
than  the  direct  axis  (5  s).  Therefore  we  assume 
that  e'd  is  fast  and  «'  is  slow,  and  order  the  states 
as  follows: 

*«»  R />  6,  co,  Efd,  Vh  (64) 

considering  e'v  Rf  as  slow  and  the  remaining  five 
variables  as  fast.  Upon  linearization  of  the  non¬ 
linear  model  at  the  nominal  values  given  in  Fig. 
4.  the  system  matrix  is  as  follows: 


-0.58 

0  0 

-0. 

269 

0 

-1.0  0 

0 

0 

0  -5.0 

2.12 

0 

0  0 

0 

—  0.141 

0  0.141 

-0.2 

0 

0  0 

0 

j_-  r  3 

66.7  -116 

40.9 

0 

0.2 

0  ” 

0 

1.0 

0 

0 

0 

0 

377 

0 

0 

-0.28 

0 

0 

0 

0.0838 

2.0 

0 

-66.7 

-16.7 

The  system  eigenvalues  -0.36i;0.56.  -0.86 
±jSA.  -3.93,  -8.53i;8.22  also  indicate  that 
there  should  be  two  slow  and  five  fast  states.  In 


view  of  the  remark  in  Section  4  we  proceed  with 
iterations  without  an  explicit  value  for  e. 

The  post-fault  simulation  results  using  the  sub¬ 
systems  are  quite  revealing.  The  simple  qss  slow 
model  causes  iarge  errors  in  the  linearized  states 
AeJ  and  &Rf  (Figs  5  and  6).  After  only  one 
iteration  of  the  slow  and  fast  subsystems  {j»k 
at)  the  error  is  practically  unnoticeable.  The 
response  of  fast  state  for  both  the  uncorrected 
fast  model  and  after  one  iteration  is  shown  in 
Fig.  7.  That  is  typical  of  all  five  fast  states. 


6.  A  CORRECTION  METHOD  FOR 
NONUNEAR  SYSTEMS 

With  minor  modifications  the  iterative  pro¬ 
cedure  of  Section  4  is  applicable  to  linear  lime 
varying  systems.  It  can  also  be  extended  to 
nonlinear  systems  of  the  type  (7),  (8)  where  /  and 
%  are  continuous  and  differentiable  in  all  its 
arguments  by  first  linearizing  (7),  (8)  along  the 
trajectory  (14),  (15)  and  then  applying  the  me¬ 
thod  for  linear  time  varying  systems.  As  in  stan¬ 
dard  asymptotic  expansion  methods  this  requires 


Flo.  5.  Slow  variable  drj:  exact  (joIkIL  approximation 
[dolled  tat]  and  alter  one  iteration  [dotted  ibi]. 


Fic.  6.  Slow  variable  SR,'  exact  I  col  id  I.  qs»  approximation 
[dotted  lal]  and  alter  one  iteration  [doited  (b i] 


Singular  perturbation  and  iterative  separation  of  time  scales 


Fig.  ’  Fast  'sriabie  di>:  exact  (<olidl.  jjj  approximation 
[doited  i a)]  and  after  one  iieration  i»amc  on  exact). 


the  time  varying  Jacobian  matrices  fx,  /.,  gx,  g. 
and  the  inverse  of  g„  From  a  computational 
point  of  view  it  is  more  desirable  to  deal  with  / 
and  g  directly.  AHemong  (1978)  has  proposed 
such  a  method  for  a  class  of  nonlinear  systems 
including  power  systems  considered  here  and  in 
the  companion  paper.  In  the  following  outline  of 
the  method  we  drop  r  from  /  and  g  and  let  t0 
»0. 

Section  2  discussed  the  problem  of  obtaining 
reduced  order  models  for  nonlinear  systems  wi¬ 
thout  corrections.  Equations  (9),  (10)  and  (13) 
yield  these  approximations.  Using  these  solutions 
for  x„  2,  and  zr  we  proceed  as  follows. 

Let  be  a  root  of  g»0  in  (10). 

Substitute 

z-i!f(.x)+»t  (66) 

into  (7)  and  assuming  that  the  nonlinearities  in  x 
and  :  are  separable,  (7)  may  be  written  as 

Xmf(x,^(x))  +  fz(>l>{x),n) 

-/.(*)+/2W*).'T),*(0)-x0.  (67) 

Note  that  neglecting  f2,  which  contains  the  do¬ 
minant  fast  part,  yields  the  slow  subsystem  (9), 
(10). 

The  integral  form  of  (67)  is 

+  /l(.x)dr-t-|'  /j(tKx),  if)dt-fc 

(68) 

where  we  have  added  and  subtracted 

J*  -/)dr  (69) 

where  z„  zf  are  obtained  from  (9).  (10)  and  (13). 


To  better  approximate  the  state  x  we  introduce 
the  expression  x»{,  +xt  and  solve  the  stow  part 
as 

4,-/,U,U,(0)-x0  +  k  (70) 

that  is.  we  include  the  influence  of  the  fast  part  as 
a  shift  k  in  the  slow  initial  condition.  The 
remaining  terms  in  (68)  are  fast  and  are  solved  by 
approximating  iji(x)  with  z,  and  by  zr,  that  is 

XfA(:vzfhx,(0)--k  (71) 

where  z,  is  known  from  (9),  (10)  and  zr  from  (13). 
If  desired,  the  next  step  can  be  a  further  improve¬ 
ment  of  the  fast  subsystem 

»), -g(<Ji  +■*/.  i.-Mi).  7i(0)-z°-z,(0)  (72) 

where  xf  and  z,  are  now  known  from  (10), 
(70)  and  (71)  (Allemong,  1978). 

This  method  has  been  tested  on  the  single 
machine  model  (16M13),  (60H63).  The  only 
types  of  nonlinearities  in  these  equations  are  sine 
and  cosine  functions  and  the  saturation  Sc(£/4). 
Limit  type  nonlinearities  on  VK  are  not  con¬ 
sidered  here.  The  uncorrected  slow  variables  ev 
and  Rf,  obtained  from  (9),  (10)  are  shown  in  Figs 
3  and  9.  Then  the  corrected  and  Rfu  are 
solved  from 

*mm-  Jr-  {[n-(*<-.ny>,, 

1  40 

+  (X4  -X')Y  Vsin  <5,  -  Efu)  (73 ) 

"4  <£,<.-*/«)  (74> 

e^(0)-e,(0)^k„  RfK.Rf(0)+k,  (75) 
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Fig.  10.  Fut  variable  S\  exact  (solid),  qu  approximation 
[dotted  (a)]  and  after  one  iteration  [dotted  (b)]. 


*t 


(Xi-X')YVC* 

7"io  J  o 


F(S„  6,)dt 


(76) 


where 


*z 


Efifdt 


(77) 


Fid,,  <5/)»sint>1(cos<5/-l)J-cos<51sin<5/.  (78) 
Their  fast  parts  are  solved  from 


i',--£-HX4-X-)YVF(6„  6f) 

1  40 

“£/</)•  *r/(Q)**  ~ 

F-f/m-=rEf4f,  Rj-fi0)m—k, 

>r 


(79) 

(30) 


’■\here  6,.  F.ru,  are  known  from  1 10)  and  A,.  £;J/ 
arc  obtained  from  the  uncorrected  fast  model 
113).  The  corrected  slow  variables  are  in  Figs  3 
and  9  and  the  quality  of  the  approximations  is 
almost  as  good  as  in  the  linear  case.  The  un¬ 
corrected  and  corrected  fast  variable  6  is  shown 
in  Fig.  10.  The  behavior  of  other  fast  variables  is 
similar.  Although  this  method  requires  further 
testing,  these  first  experiments  are  encouraging. 


T  CONCLUSIONS 

This  paper  discusses  the  application  of  singular 
perturbation  methods  to  eliminate  the  incon¬ 
sistencies  of  the  classical  quasi-steady-statc  ap¬ 
proach  to  model  reduction.  The  iterative 


method  presented  is  a  means  for  improving  the 
accuracies  of  the  reduced  models.  A  correction 
method  for  nonlinear  systems  with  sine,  cosine 
and  exponential  nonlinearities  is  also  presented. 
The  modeling  and  separation  of  time  scales  are 
illustrated  by  several  systems  common  in  electri¬ 
cal  engineering.  Further  application  of  the  me¬ 
thod  is  developed  in  the  companion  paper 
(Winkeiman  and  co-workers,  1980). 
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Through  a  couple  of  naive  examples  the  control 
theorists  are  invited  to  reexamine  the  role  of  mod¬ 
eling  in  the  study  of  large  scale  dynanic  systeas. 
Instead  of  sasuming  the  existence  at  "If  diagonally 
dominant  blocks,"  they  should  identify  one  strongly 
coupled  slow  core  and  M  weakly  coupled  fast  subsystems. 
This  structure  la  exhibited  with  a  physically  aaanlng- 
ful  choice  of  state  variables.  The  controls  ere  intro* 
duced  following  the  recent  concept  of  amlclnodeliag. 


interactions  defined,  the  next  seep  la  co  form  the  sub* 
systems  as  groups  of  units.  A  criterion  for  this 
grouping  say  be  to  require  chat  the  "inner"  inter* 
actions  be  stronger  than  the  "outer"  interactions , 
chat  la,  a  unit  should  be  coupled  sore  strongly  with 
the  units  in  its  own  subsystem,  than  with  the  ocher 
units,  tepreseaclag  the  interactions  of  n  units  as 
the  entries  of  an  nan  aatrix,  the  decomposition  Into  N 
subsystems  Is  considered  to  be  poaslble  If  there  is  an 
ordering  mf  the  units  for  which  the  Interaction  matrix 
possesses  S  dominant  diagonal  blocks. 
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Most  control  studios  of  large  scale  systems  start 
with  a  nodal  poss easing  sons  known  hlararchlcal  or 
diagonal  dominance  properties .  This  easuaptlon 
expresses  our  dsairs  co  escape  Che  cask  of  modeling. 

Ac  cha  extrema  era  eha  rssesrchsrs  for  whoa  it  is  sore 
rational  to  daaign  aeracagiss  for  controlling  an  unknown 
plant,  chan  to  first  spend  some  tins  developing  a  modal 
for  It.  In  simpler  sad  similar  size  systems  a  cartaia 
disregard  of  modeling  la  tolerable.  The  situation  la 
diffaraa:  la  large  ecale  systems  whare  cha  phenomena 
occurring  are  co«  rich  to  be  handled  by  all-purpoee 
control  strategies.  Consider,  for  instance,  the  stabi¬ 
lization  stracaglaa  baaed  on  the  assumption  of  diagonal 
dominance ,  and  designed  by  vector  Lyapunov  function 
methods  iSiljak,  1978).  As  eha  two  power  system 
examples  in  -Ionic  seel.  (1978)  and  Grujle  ac  al.  (1979) 
show,  the  success  of  chass  stracaglaa  critically 
dapaods  on  what  is  modeled  as  a  subsyscam.  If  cha  sub¬ 
systems  are  simply  taken  co  bo  cha  Individual  gener¬ 
ating  units,  the  results  are  extremely  conservative. 

With  a  careful  cholca  of  "coharene  araaa"  aa  subsystems , 
cha  rssulcs  become  more  meaningful . 

Inscaad  of  assuming  chat  an  "off-the-shelf"  modal 
is  alraady  available  in  a  hast  weakly  couplad  form,  a 
daeper  understanding  of  the  causae  for  »sak  coupling 
muse  be  gained  and  used  In  modeling  of  subsystems.  In 
chla  paper  we  make  aa  attempt  In  this  direction,  tfe 
first  examine  the  relationship  of  diagonal  dominance 
and  time  scales  in  cha  decomposition  of  Markov  chains 
and  show  chat  similar  decompositions  apply  to  elec¬ 
trical,  mechanical,  and  electromechanical  networks. 

'As  then  outline  e  grouping  procedure  for  determination 
of  subsystems  and  separation  of  clma  scales.  A  genaral 
property  of  the  considered  systems  Is  chat  they  era 
strongly  couplad  In  the  slow  time  seals,  and  weakly 
coupled  la  the  fast  time  scale.  Qua  to  this  property 
every  subsyscam  controller  can  neglect  all  other  fast 
subsystems  except  for  his  own.  This  aultlmodsliag 
situation  la  discussed  la  the  last  ssetion  of  cha 
paper.  To  highlight  cha  Ideas  and  avoid  technicalities , 
cha  pspsr  Is  vrlccan  as  an  informal  discussion  of 
reprasencaciva  examples.  Mora  general  and  rigorous 
treatment  can  ba  found  in  quoted  raferancaa. 
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la  attempting  to  decompose  a  system  into  sub¬ 
systems,  cha  first  scap  la  co  identify  cha  •unite  of 
the  system  and  quantify  their  Interactions .  This  la 
a  nontrivial  task  and  ica  ourtoms  cay  hava  to  be 
ravlsad  eftar  subsequent  acaps.  With  units  and 


For  dynamic  systems  wa  broaden  this  reasoning  to 
include  a  separation  of  time  scales.  Sines  tha 
aggregation  of  Markov  chains  Is  a  particularly  elaar 
illustration  at  this,  vs  bagin  with  a  singular  pareur- 
baclon  interpretation  of  cha  results  of  Pervorvenaki 
and  Smirnov  (1974) ,  Gaits go ri  and  Fervocvanakl  (1975) , 
and  Dalabacque  and  Quadrat  (1978,1980). 


In  a  system  described  by  a  finite  scats  Markov 
chain,  the  states  ere  the  units  of  the  system  and  their 
lnterections  ere  the  transition  probabilities.  If  soma 
of  these  interactions  are  weak,  they  can  ba  neglected 
over  shorter  periods  of  elms.  For  example.  In  the 
four-seats  chain  In  Fig.  Is,  wa  may  choose  to  neglect 
all  the  interactions  smaller  than  dr  equal  co  .2. 

Than  tha  stacas  are  grouped  into  two  classes :  1,2 

and  3,4.  By  increasing  tha  self-lncaracclons  co 
compensate  for  cha  neglaccad  weak  interactions  cha  two 
"fast"  chains  can  be  formed  aa  in  Fig.  lb. 


Fig.  1 


This  means  that  cha  laac  matrix  in 


Cl  .8  0  .1 

|.6  .2  .1  .1  „ 

J  0  .1  .2  .7 

L1  0  .6  .3 

has  been  neglaccad. 
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.1  o  a  i! 
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0  .1  -.1  Of 

.10  0  -.11 

(1) 


Preparing  for  an  asymptotic  analysis,  wa  repre¬ 
sent  ail  eh*  weak  Interactions  aa  muleiplts  of  a  small 
positive  scalar  c,  that  la  am  rapraaaae  cha  iaae  matrix 
la  (1)  by  £&]_.  Furthermore,  w*  denote  by  A«+I  and 
Ag+I  cha  transition  matrices  of  cha  chains  la  Fig.  la 
and  b,  raapacelvaly ,  obaarvlag  chae  cha  row  turn*  of 
Ac,  A0,  aad  cA,  ara  all  zaro.  Thus  a  gaaaral  axpraa- 
sioa  of  eha  eypa  (1)  la 

(Af+I)  -  (Ag+I)  +  cA.  (2) 


probability  than  p.  *  y.q, .  This  noclvaeaa  eha  rapra- 
Maeacloa  of  p  aa  3  3 


p  -  yq  +  tW,  W8-0  (7) 

uhara  a  la  aa  (a-N)-rov  aad  eha  cholca  of  eha  constant 
(n-N)*n  aaerlx  U  la  la  agraaaaac  with  (4)  aad  16). 
Intuitively  eha  earn  raprasaaea  fast  fluctuations 
around  yQ.  If  wa  multiply  (7)  by  aa  ox(a-N)  aaerlx  S 
such  ehat 


By  this  construction  Aq  la  aada  of  diagonal  blocks. 
Each  block  coneribut aa  ona  right  aad  oaa  lafe  elgaa- 
.  vaceor  of  Ag  for  A*0.  Tha  right  alganvactors  ara  of 
eha  fora  [00111000]’,  where  '  daaocaa  a  eraaapoaa, 
aad  eha  nuabar  aad  eha  position  of  eha  onas  ara  daear- 
xlnad  by  eha  dimension  aad  eha  position  of  eha  dia¬ 
gonal  block  la  Aq.  Similarly,  eha  lafe  aiganvaccora 
ara  of  eha  fora  (0  0  <1,41+1  q,+»  0  0  0]  wfcera  q, 
ara  eha  seacionary  probaoiileias  for  t-0  or 
a cacao  1,  1+1,  1+2  la  eha  Sana  class  aad,  hanca,  ehair 
sun  la  ona.  For  aa  n-acaea  chain  wieh  S  blocks  eha 
right  aiganvaccora  of  Ag  for  \«0  fora  aa  oxN  aaerlx  R 
aad  eha  lafe  aiganvaccora  fora  aa  Nxa  aaerlx  Q.  la 
our  example  (1)  wa  have 


'ter 


(3) 


To  susBarlsa,  eha  right  aad  laft  null  spaces  of  Ag  ara 
characterized  by 


QS-0,  VS-I^, 
chan  eha  raaule  la 


(8) 


a  ■  pS. 


(9) 


Wa  need  eo  choose  S  for  a  meaningful  definition  of  t, 
satisfying  (8).  la  our  exrap la  such  a  choice  la 


S  • 


-L 

<i 

*2 


’3 


£i  It 

g  a  — * - *• 

1  4j,  <2 


p3  pi 

z  m  —  -  — ■ 

2  4,  4* 


(10) 


AoR  -  0,  0Ao  -  0.  Q*  -  I,,  (4) 

where  Ij,  la  eha  MxH  identity. 

Lae  ua  now  fora  a  continuous  ciaa  nodal  of  cha 
chela.  Assuming  that  (A,+I)  la  eha  transition  aaerlx 
In  ’’fate”  eloa  tf ,  eha  eraaaleioh  aaerlx  la  slow  elms 

t«ttj  la  ^  (Af+I) .  For  axaapla,  if  c»y  aad  If  e;  la 

la  days,  ehaa  e  will  be  la  waeks.  Since  wa  ara  lacer- 
eaeed  la  eha  longer  ears  behavior  of  the  chain,  wa 
will  use  eha  nodal  la  slow  ciaa 

9  *  i  pAt  *  A0>*1)  <3> 


Tha  corrsapoadlag  W  la  than 


4^2  ^2 

0  0 


'll* 


0 

3*iJ 


(11) 


la  general,  fase  variables  zL  should  ba  defined  aa 
velgbeed  differaacaa  of  probabilities  within  a  daas. 

Wa  now  uaa  (7)  to  axpraas  (3)  in  cans  of  v  aad  z. 
After  simple  manipulations  wa  obtain 

y  •  yQA^R  +  zWA^R  (12) 

ci  *  tyQAjS  +  zF  (13) 


where  eha  n-row  p(e)  la  eha  probabllley  diacrlbueloa  ae 
tins  e.  If  eha  Initial  diacrlbueloa  p(0)  la  far  from 

?(0)Ag  -0,  than  •*  pA  »  ?a.  aad  eha  Initial  fase  eraa- 
slaae  can  ba  approximately  determined  from  ?  *  f  pAg . 

Since  Ag  la  block-diagonal,  eha  fase  cranslene  Is 
formed  of  separata  eraaslanes  within  eha  classes . 

After  soma  c  eha  probability  p(e)  will  ba  c  dose  eo 
eha  compoalea  of  eha  aeaelonary  distributions  within 
cha  S  ciaaaaa.  From  ehaa  on  ?A^  is  no  loagor  negli¬ 
gible  with  raapace  to  pAg  aad  tha  traaaltlona 

beeveen  tha  classes  must  ba  takaa  Into  account.  To  do 
this  lee  us  introduce  yi  -  tha  aggregate  probabllley 
for  eha  scaca  eo  ba  la  the  ieh  class.  Tha  :l-row  of  eha 
•tgragaea  probabllleiaa  la 

y  ■  pR.  (6) 

la  our  axaapla  (1)  this  simply  means  y,  •o,+o,1 
y,  *p,+p..  Tha  probability  p,  eo  ba  18  seaea^j  can  ba 
axpraaaaj  aa  eha  probabllley  3y,  eo  bo  la  lea  claaa 
eiaaa  eha  probabllley  eo  ba  la  That  scaca  whan  In  eha 
clast.  If  eha  laeear  la  approximaead  by  eha  seacionary 


where  eha  (n-N)x(n-N)  matrix 

F  -  WUg+«Al)S  (14) 

la  scabla.  By  having  transformed  (3)  Into  eha  aesadard* 
singular  parturbaelon  fora  (12),  (13),  wa  have 
accomplished  ona  of  eho  goals  of  this  section.  IC  Is 
seralgheforward  now  to  analyte  eha  time  scale  proper- 
elas  of  (12),  (13)  using  asyvpcoclc  or  learaelva 
techniques,  such  as  la  Xokocovic ,  O’Malley,  and 
Saanuel  (1976)  aad  Rokocovlc  ae  al.  (1980).  Tha  slow 
subsysera  of  (12),  (13)  Is 

?  -  y (Q A^R-tWA^RQA^ SF~ ^ )  ■  y  A.  (13) 

For  c-Q  le  raducss  eo  eha  aggragaea  proposed  by 
Smirnov  and  Farvozvanaki  (19*4).  Tha  craaslcioa  matrix 
(A+I^)  rapraaanea  an  tggrtgaca  chain  vhoas  seaeaa  ara 
eho  clastae  of  eha  original  chain.  For  our  axacpla(l) 
this  matrix  is 

‘.84  .16' 

.1  .9 


(A+t>|) 


(16) 


0 


and  eh*  t||ri|ici  chain  la  shown  la  Fig.  lc.  Tho 
fast  fluctuations  in  approximately  governed  hr 

<**« 

dej  “  V  •  -*e 

wham  cha  nimmrlcal  values  in  for  our  example  (1). 
it  la  crucial  eo  point  ouc  chat  dua  to  cha  torn  (14) 
of  F,  lea  diagonal  blocks  arc  Indeed  dominant .  The 
eigenvalues  of  F  la  the  example  -.14  and  -0.09  are 
dose  to  lea  diagonal  eleaaaea.  dance,  (17)  describes 
M  aeparaes  fluccuadona  within  each  of  eha  S  claaaaa. 
Sven  chough  ermaaldon  probablliciea  as: large  as  0.2 
have  been  negleceed,  the  approximation  la  excellent, 
the  scadooarr  probability  dlacribuelon  p-  (.18  .21 

.28  .33]  la  approximated  by  ?0“[.17  .22  .28  .33]. 


Our  final  conclusion  la  ehae  eha  odglaal  chain 
(3)  should  be  decomposed  not  taco  H,  but  Into  S+l 
subsyacema.  One  of  them  la  the  slow  subsystem  which 
defines  ehe  Markov  chain  of  S  strongly  coupled  aggre¬ 
gate  seaeas.  The  remaining  H  fast  subsystems  are  noe 
Markov  chains,  but  repraaenc  internal  fluctuations 
within  ehe  S  claaaaa. 


i  •  *c« 


jes 
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0 


0 


(18) 


where  denoting  r  ■  cl  ehe  aaerix  A  la  expressed  as 
A  ■Aa*«A1,  ehae  la  * 
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(19) 


HETWOAK3.  SPBWTTWM3.  AMO  TPg  SCALES 

A  similar  reasoning  can  be  used  eo  determine  else 
scales  and  subsystems  of  electrical,  mechanical,  and 
alectronacnanlcal  networks . 


Ue  note  that  a,  represents  the  two  subnetworks  In 
Fig.  2b,  which,  due  to  the  all- inductor  loops,  possess 
equilibrium  subs paces.  If  the  initial  currents  sre 
far  from  thoeo  subspaces,  xl(0)^x-(0)  and  x.(0)#x,  (0) , 
the  currants  (xj-xj)  and  (xj-x, will  flow  through 
ehe  reaiaeore  X,  governed  by 


— <ttv— ^  <tp—  |«- 


(6) 


Fig.  2 


As  an  Illustration  we  conaidar  a  simple  Rl-naeworfc  In 
Fig.  2s,  where  the  inductors  art  of  eha  same  ordsr  of 
magnitude,  end  the  noauniforaity  of  interactions  Is 
due  eo  the  feet  that  the  realseors  A  ere  much  larger 
than  ehe  raalacors  r.  This  non  uniformity  suggaaea 
ehae  there  may  exist  s  way  to  approximate  eha  network 
by  some  simpler  subnetworks .  The  syseaa  equation 
with  the  Inductor  currents  as  the  statea  Is 


(Wc 


(Wo 


Vo’ 


(20) 


where  * 


4*4 


(  )  indicates  that  only  A  , 
o  o 


that 


ia  c"0,la  considered.  The  subeystame  (20)  era  "fast” 
because  A  is  large,  and  cha  corresponding  "fast”  sub¬ 
networks  are  shown  In  Fig.  2c.  'Jhen  the  subnetwork 
equilibria  are  approximately  reached,  the  state  x  Is 
close  to  the  null-space  of  A„  and,  hence,  cA,x  ia  no 
longer  negligible  with  respect  to  As.  In  the  long 
term,  the  state  of  (18)  will  continue  to  be  in  the 
neighborhood  of  tho  null-sapca  of  A ,  whose  basis  we 
denote  by  7,  an  a*H  matrix  which  in  this  example  has 
the  columns  [1100]’  and  (0011] ’ .  Aaprasanclng  x  as 


x  -  Vy  v  Hx,  AoV  -  0  (21) 

and  Introducing  matrices  M  and  P  satisfying 

M7  •  Ijj,  MH  ■  0,  PH  -  Ia_H,  PV  -  0  (22) 

we  obtain 


y  •  Mx,  s  ■  ?* 


(23) 


tdtere  y  will  ba  the  slow  and  x  cha  fast  variables. 
Since  we  have  alrsmdy  observed  chat  x,-xj  end  x--x. 
ere  fast,  lac  us  use  this  observation  and  (22)Jto* 
determine  ?.  For  our  example  this  will  ba 


-1  O'  o' 
0  1  -l. 


*1  ’  *1**2 
*2  *  *3**4 


(24) 


which  satisfies  PV*0.  Than  using  3  and  M  In  the  fora 


.OS  .77  8.47  13.  S 
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*2  0  0 
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(23) 


we  im  from  tha  first  three  conditions  of  (22)  that 

h-V  Vi*1 

V“»  - 1.  i,  -  ■,<«,  •  u 

Physically  meaningful  quantities  which  satisfy  Chius 
relations  srs 

Vi^*  4’i^q*  4*vv  ®4*q+^-  (27) 

Thus  ws  in  chat  our  ''slow”  currant*  ara  cha  veighced 
sums  of  cha  currants  within  cha  subnetworks 


4 

4 


t2 

4^2  **■  +  4+4  *2 


(28) 


-^Casework) 


-^(subnetworks) 


.09 


.78  8.33  13.0 


Tha  accuracy  can  ha  improvsd  by  Includlnf  cha  t-csrms 
and  still  keeping  cha  subnetworks  decoupled.  1st  us 
remind  tha  raadar  chat  wa  have  axaainad  tha  asymptotic 
behavior  of  (18)  as  c*0  by  Introducing  r*d. 

For  connoisseurs  of  singular  perturbations  it  soy 
be  of  Inter aoc  eo  notice  chac<had  we  iaacaad  substi¬ 
tuted  l*|  la  (18),  we  would  have  obtained  a  singular 
singularly  perturbed  sysesa.  Following  a  different 
route,  such  as  In  Campbell  (1979),  we  would  have 
arrived  at  the  sane  standard  for*  (29). 


a  aaass  ^sbsssl  gasa  ss.  '^sssbssi 

although  this  nay  aoc  be  obvious,  cha  problen  we 
hava  been  discussing  is  a  disguised  version  of  a  well 
known  problen  la  power  systaa  analysis.  Most  power 
engineers  ara  familiar  with  the  problen  of  grouping  of 
synchronous  nachinas  into  coherent  areas.  Tha 
literature  on  this  subject  la  rich  and  will  not  be 
quoted  here.  Only  a  recently  developed  algorithm 
(Avramovic,  1980;  Avramovic  at  al.  1980;  Winks laan 
at  al.  1980)  will  ba  inclined  because  of  its  direct 
connection  with  the  preceding  two  sections.  At 
present  Avraaovie's  algorltha  is  being  applied  to 
conservative  systans  of  the  forts  • 


It  is  worth  noting  Chat  y,  and  y,  are  not  exactly 
analogous  to  the  Markov  chain  example,  where  y,  •  p.+p, 
and  y nor  (24>  analogous  to  (10). 

Sower* r,  had  we  taken  the  fluxes  as  cha  state 
variables  Instead  of  the  currents,  the  analogy  would 
have  bean  complete.  Applying  che  erans formation  (24), 

(28)  to  cha  original  system  (18)  and  expressing  R-f 
we  obtain  che  singularly  perturbed  system  analogous 
to  (12).  (13) 

7.  *  ™  7,  7* ,  y.  a,*,  *  42*2 

72  £.3^4  4  4+4  4*44*4*2  (29) 

*4  •  *Vl *  eV2  -  r(4’4)ll* **7*2 
ti,  -  t.3yl  +  ta,y2  v  ta10*1  -  c(^-£)s, 

where  che  coefficients  a- , . . . are  of  che  form  r 
divided  by  appropriate  inductances.  The  first  point 
we  went  co  sake  is  chat  cha  fase  subsystem  aacrlx  of 

(29)  is  diagonally  dominant.  Its  diagonal  entries 

-R(r^~+r^*) ,  -ROp--*--^-)  represent  the  subnetworks  la 

4  4  4  4 

Fig.  2c,  as  expocted.  The  second  important  point  is 
chat,  up  co  an  t -error,  the  slow  subeyscea  represents 
che  subnetwork  in  Fig.  2d.  Thus,  tha  subnetworks  of 
the  original  nacwork  in  Fig.  2a  ere  che  ewo  feat  sub¬ 
networks  in  Fig.  2c  end  ons  slow  subnetwork  la 
Fig.  2d.  A  simple  rule  is  eppsrent:  che  fast  sub¬ 
networks  are  obtained  by  considering  che  snail 
resistors  r  as  short  circuits,  while  the  slow  sub¬ 
network  is  obtained  by  considering  Use  large 
resistors  R  as  oosn  circuits.  It  asy  cons  as  a 
surprisa  that  ehia  simple  rule  yields  tn  excellent 
approximation,  as  it  esa  be  seen  from  che  comparison 
of  che  actual  nacwork  eigenvalues  with  the  subnetwork 
eigenvalues 


x  -  (Ao+*A1)x  -  Aex  (30) 

such  as  electromechanical  aodels  of  power  systems,  mass- 
spring  models  of  flexible  structures  etc.  In  power 
systems  x  represents  cha  rotor  angles. 

Tha  so  called  slow  coherency  problem  is  co  find 
the  groups  of  nachinas  which  "swing  together"  with 
respect  eo  X  slowest  modes  of  A,.  Tha  machines  1  end  j 
for  which  che  difference  x^-x,  contains  a  negligibla 
contribution  of  slow  modes ,  ara  grouped  in  the  same 
cohermne  area.  If  7e  is  a  basis  n*K  matrix  for  the 
selected  X  slow  modes  of  A,,  than  che  eacrles  of  the 
ich  row  of  7{  are  che  weights  with  which  the  modes 
appear  in  the  sears  x,,  If  che  rows  1  and  j  sre 
Identical,  cha  machines  i  and  j  ara  coherent,  chat  la 
x^-x,  contains  only  fase  modes .  Avramovlc’s  algorithm 
psrmotes  tha  ordering  of  cha  scat  as,  that  is  the 
ordering  of  the  rows  of  7S,  until  the  first  X  rows 
become  as  linearly  independent  as  possible.  Tha  X 
machines  corresponding  eo  thasa  rows  definitely  ere  noc 
coherent  end  tech  can  be  used  as  a  reference  machine 
for  a  distinct  area.  To  associate  ocher  machines  with 
chess  reference  machines  denote  cha  first  X  rows  of  vc 
by  7^  end  che  remaining  s-X  rows  by  72.  Xow,  when  7( 
is  poscmultlpllsd  by  7^1  a  macrlx  L*7jY  appears 


which  is  the  mala  tool  of  tha  grouping  algorithm. 

Tha  fast  variablas  ara  than  defined  as 

t  -  x2  -  Lx1  (32) 

where  x~  it  cha  subvactor  of  cha  angles  of  all  cha  X 
refaranea  machines  and  x‘  of  cha  remaining  n-X 
machines.  The  slow  coharsace  is  approximately 
achieved  if  each  raw  of  t  conceits  only  one  entry 
dote  to  one,  and  all  ochar  sneriea  close  to  taro. 


3y  replacing  eh*  near-ons  entries  by  oass,  aad  the 
near-taro  sacrist  by  zeros,  a  "fro up log  aaerix"  L,  la 
formed.  Whan  used  to  raplaca  L  In  (32)  chi*  matrix 
L_  defines  the  componencf  of  zh*  who#*  difference# 
with  cha  component*  of  x*  in  (32)  ara  predominantly 
fast.  Thay  chan  b along  to  cha  araa  whose  reference 
is  cha  component  of  appearing  in  tha  difference . 

If  v*  vara  to  apply  Avramovic ' *  algorithm  eo  our 
network  la  Fig.  2a,  va  would  find  chat  x,  and  can 
ba  uaad  as  "rafaraaea  eurraacj."  Thay  will  ba  cha 
components  of  x^  aad  xj_  aad  X3  cha  soapoaaacs  of  x^. 
Than  (32)  with  Lg  replacing  1,  would  bacons 


.r^i  fx  °i r*2 

.*3]  L°  lJU 


which  is  la  agreement  with  (24) . 

What  diaelaguishaa  Avramovic 's  algoricha-  from 
cha  discussion  la  cha  pracadiag  s actions ,  la  chat  ie 
aliainacas  cha  oaad  for  aa  asp licit  tapa ration  of  A 
la co  a  aad  tA..  lascaad  of  a  grouping  based  on  cha 
null-spec*  of  a  haurlselcally  or  empirically  eon- 
scruccad  aacrlx  a,,  this  algoricha  coapucaa  a  heals 
V,  for  cha  actual  slow  eigaespaca  of  1,  aad  chan 


basis  7C 

for 

p0.33 

0.66' 

J  0.36 

0.67 

0.61 

0.21 

.0.62 

0.23. 

which,  after  a  permeation  co  place  cha  rows  2  sad  4 
as  chs  first  two  rows,  glvss 

’0.36  0.67}  fo. 33  0.66]  .  f  1.007  O.OSl 

7,«  ,7-  .  7  7*1  -  (33) 

*  Lo.62  0.23}  4  1.0.61  0.21J  4  1  L-0-07  1.02} 

Th*  final  scap  Is  eo  approximate  v.vr1,  by  cha 
grouping  aacrlx  la  (33) . 

A  comoo  feature  of  our  two  sxasplss  sad 
Avremovic ' i  algoricha  Is  a  search  for  a  sac  of 
physically  asaoicgful  scac*  variables  co  exhibit  chs 
subsystem  aad  chair  elm  scales.  Of  course,  eh*  eiaa 
scales  of  linear  dm  invariant  system  can  b* 
exhibited  by  nodal  transformation* ,  but  eh*  asaning  of 
the  nodal  variables  nay  bs  far  froa  chs  nsaniag  of 
eh*  original  scac*  variables.  Th*  original  tcaca 
variables  obtained  fro*  physical  laws  or  sxpsriaancs 
contain  a  wealth  of  lntuieiva  aad  empirical  Informa¬ 
tion  which  a  rational  aodslar  vaata  to  prasarvs.  Our 
examples  tlluacraca  How  thla  can  b*  aceospliahsd  by 
a  construe  civs  use  of  th*  dscomposltlons  such  as  (7) 
aad  (21),  which  te  aa  algabralse  ar*  oars  projections. 
With  physically  meaningful  subsystem  not  only 
Linearized,  but  also  coni In  ear  analysis  will  b*  sim- 
pliflsd.  Ia  a  r scant  application  (Vlnkalsaa  at  al. 
I960)  of  Avremovic'*  algorithm  to  a  nonlinear  48 
machine  model  of  eh*  Sea tern  Uni cad  Seat as  power 
ayeem,  aonliaaar  analogs  of  th*  subsytceos  Iden¬ 
tified  on  a  linearized  nodal  were  used.  Simulation 
rasulcs  confirmed  eh*  validity  of  the  subsystem 
oodala  and  time  scale*. 
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Thus  far  wo  haws  not  considered  tha  presesca  of 
control  inputs .  Sow  ara  thay  to  ba  allocated  among 
eh*  subsystam?  Political,  geographic,  aad  ochar 
issues  aay  lnctrfars  with  our  serlcely  dynamic 
criteria.  A  transformtion  of  sa  original  aodel  into 
a  model  exhibiting  elm  scales  and  subsyteam  will 
also  transform  the  control  aaerix  B.  Whan  transformed, 
at  leant  on*  control  variable  should  be  allocated  eo 
each  face  subsystem  while  eh*  presence  of  other  fast 
aubaysem  controls  should  be  weak.  If  this  is  ace  cha 
case  with  eh*  original  control  variables,  voluntary 
grouping  of  craerol*  sad  aucual  release  of  control 
authority  ia  required.  After  this  has  been  accom¬ 
plished,  tha  linearised  model  of  a  large  scale 
system  exhibiting  osa  slow  aad  it  fast  subayaesns  can 
ba  written  aa 


*-v 
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where  we  have  allowed  eech  feat  subsystem  co  have  a 
different  small  parameter  c.  aad  eo  be  weakly  coupled 
eo  oeher  fast  subsystam  through  ctj .  Th*  fast  sub¬ 
system  i  is  controlled  by  its  own  input  u^.  The  slow 
subsystem  (36)  is  the  common  slow  "core”  and,  in 
general,  will  have  the  input  from  several  or  all  faac 
subsystem  controls. 

In  a  situation  like  this  it  is  rational  for  a  fast 
aubaysem  controller  eo  noglect  all  ochar  feat  sub¬ 
systems  aad  co  eoacancrsca  on  Its  own  subsystem,  plus, 
of  course,  the  slow  interaction  with  others  through 
the  "core."  For  cha  1th  controller  "to  naglocc  all 
other  subsystem"  simply  means  eo  see  all  c  parameters 
equal  co  aero  except  for  t,  which  is  co  ba  kept  at  Its 
true  value.  The  ith  controller'*  simplified  aodel  is 
then 

V^rtV'olVjkVj  (38) 

,l*l*AU3rl*AttV,li“l  (39) 


A*  ’  A«‘3$AlAJjV  VWfcV  UJj 

We  denote  y1  with  *  superscript  rather  than  a  subscript 
to  screes  the  feet  thee  y*  is  not  s  component  of  y, 
but  the  ith  controller's  view  of  y.  In  reality,  che 
modal  (38), (39)  is  often  ell  che  ich  controller  knows 
about  th*  whole  system.  Th*  kth  controller,  on  che 
oeher  hand,  has  a  different  kth  aodel  of  eh*  earn 
large  scale  system.  This  situation,  called  multi- 
modeling,  ha*  been  fonsulattd  and  investigated  ia 
Khalil  aad  Kokocovic  (1978,  1979a,  1979b,  I960)  and, 
more  broadly,  ia  7olum*  II  of  cha  a.S.  Department  of 
Energy  report  (Flak  aad  Trygar,  1979). 

What  remains  of  (36),(37)  when  all  c  paramaesrs 
era  neglected  is  eh*  slow  core,  which  is  ,  la 
general,  e  strongly  coupled  subsystem.  Decentralized, 
eaaa,  and  gam  approaches  eo  eh*  design  of  control 
strategies  have  been  considered  for  this  subsystem. 
Control  can  ba  divided  into  a  slow  pare,  which 

contribute*  eo  the  control  of  the  core,  aad  a  fast 
pare  controlling  only  its  own  fast  subsyecam. 

Sometime*  th*  total  authority  for  eh*  alow  subayseaa 
can  b*  dalegacad  eo  a  single  concroller-coordiascor. 

In  this  case  eha  conerol  hierarchy  would  caeurally 
aaeeh  th*  hierarchy  of  the  time  scales. 
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Singular  Perturbation  Analysis  of  Systems  with 
Sustained  High  Frequency  Oscillations*  f 

JOE  H.  CHOW,  JOHN  J.  ALLEMONG  and  PETAR  V.  KOKOTOVICJ 

Singular  perturbation  techniques,  extended  to  treat  systems  with  slightly  damped  high 
frequency  modes,  provide  better  understanding  of  the  system’s  structural  properties,  and 
they  yield  computational  advantages  since  the  resulting  subsystems  are  analyzed  in 
separate  time  scales. 

K«y  Word  iadox— Perturbation  techniques;  eigenvalues;  two  time  scales;  system  order  reduction; 
approximation  theory;  modeling;  power  system  control. 


SooHaary— Using  singular  perturbation  techniques,  a  system 
with  high  frequency  oscillations  is  decomposed  into  two  lower 
order  subsystems,  one  containing  only  the  slowly  varying  part 
and  the  other  containing  only  the  fast  oscillatory  part. 
Eigenvalue  and  state  approximations  achieved  by  the  subsystems 
are  given.  A  mass-spring-damper  example  shows  that  a  stiff 
spring  can  be  regarded  as  a  perturbation  of  a  rigid  rod  and  an 
interconnected  power  system  example  illustrates  the  occurrence 
of  coherency  and  inter-machine  oscillations. 

1.  INTRODUCTION 

Mechanical  and  electromechanical  systems  often 
have  slightly  damped  modes  oscillating  at  frequen¬ 
cies  much  higher  than  the  rest  of  the  system.  Well 
kn  wn  examples  are  spring-mass  suspension  sys¬ 
tems  and  multi-machine  power  systems.  In  linear¬ 
ized  models  of  such  systems  some  eigenvalues 
have  small  real  parts  and  large  imaginary  parts. 
Typically  they  are  due  to  either  strong  coupling,  or 
small  masses  and  inertias,  or  both.  Synchronous 
machines  connected  through  a  low  impedance  can 
serve  as  an  illustration. 

In  properly  designed  systems  the  amplitudes  of 
high  frequency  oscillations  are  small  and  their  effect 
negligible.  However,  the  analysis  and  design  me¬ 
thods  must  take  these  potentially  troublesome 
modes  into  account.  This  leads  to  numerically  stiff 
problems  requiring  expensive  integration  routines. 
A  way  out  of  this  difficulty  is  to  treat  systems  with 
oscillatory  modes  as  singularly  perturbed  systems 
and  analyze  their  slow  and  fast  parts  in  different 
time  scales.  Presently  available  singular  pertur¬ 
bation  methods[l]  assume  that  the  fast  modes 
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decay  in  the  fast  time  scale  during  a  boundary  layer 
interval.  Thus  they  do  not  incorporate  the  case  of 
slightly  damped  or  purely  oscillatory  modes.  This 
paper  extends  the  singular  perturbation  approach 
to  systems  with  fast  oscillatory  modes. 

Our  approach  is  to  decompose  a  system  with  high 
frequency  oscillations  into  two  separate  subsystems, 
one  containing  the  slowly  varying  dynamics  and  the 
other  containing  the  oscillatory  modes.  We  show 
that  the  decomposition  m  [2, 3]  is  also  applicable  to 
systems  whose  slightly  damped  large  eigenvalues 
result  in  sustained  high  frequency  oscillations.  The 
slowly  varying  dynamics  can  be  approximately 
analyzed  by  averaging  methods[4-6].  However  for 
the  linear  time-invariant  case  considered  here,  our 
algebraic  decomposition  is  more  direct  and  yields 
estimates  of  the  eigenvalues  and  states  of  the 
original  high  frequency  oscillatory  system.  This 
procedure  requires  only  the  verification  of  an 
assumption  given  in  the  next  section  and  the 
computation  of  a  matrix  inverse.  Furthermore  our 
decomposition  retains  the  meaning  of  the  physical 
variables. 

Illustrating  the  decomposition  proced  "-e  by  a 
simple  mass-spring-damper  system  in  which  one  of 
the  springs  is  stiff,  we  show  that  the  slow  motion  of 
the  masses  can  be  obtained  by  approximating  the 
stiff  spring  as  a  rigid  rod.  The  high  frequency 
oscillations  between  the  masses  are  then  analyzed 
using  a  fast  time  scale.  An  interesting  application  of 
this  procedure  is  in  the  transient  stability  studies  of 
interconnected  power  systems.  If  several  machines 
belong  to  a  'coherent'  group,  they  are  usually 
represented  by  an  equivalent'  machine[7-9].  Our 
procedure  gives  a  perturbationai  interpretation  of 
the  coherency  approach.  Moreover,  it  reintroduces 
the  intermachine  high  frequency  oscillations  by 
representing  them  separately  by  an  oscillatory 
subsystem.  Hence  this  procedure  is  applicable  when 
the  intermachine  oscillations  are  not  negligible. 
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The  organization  of  the  paper  is  as  follows. 
Section  2  outlines  the  modeling  aspect  of  high 
frequency  oscillatory  systems.  The  technique  of 
averaging  is  used  in  Section  3  to  obtain  the  slowly 
varying  part  of  the  oscillatory  states.  Section  4 
contains  our  main  results  on  eigenvalue  and  state 
approximations  of  the  subsystems.  Sections  5  and  6 
are  devoted  to  the  examples. 

2.  MODELING  OF  SYSTEMS  WITH  HIGH 
FREQUENCY  OSCILLATIONS 

Systems  governed  by  physical  laws  such  as 
Newton's  law  and  KirchhofTs  law  can  be  modeled 
as  second  order  matrix  differential  equations 

s  +  Ps'  +  Qs*  0,  s(r0)  =  s0,  s(r0)  =  s0  (1) 


where  s e  R'  and  P,  Q  are  r  x  r  matrices.  We  assume 
that  system  ( 1 )  is  in  the  form 


(2) 


where  n  is  a  small  positive  parameter  which  arises 
due  to  the  presence  of  stiff  springs  or  small  masses 
and  is  responsible  for  the  high  frequency  oscillations 
in  (1).  Then  (1),  (2)  can  be  rewritten  as  a  singularly 
perturbed  system  of  first  order  differential  equations 


where  Dlt  D,  are  mx  m  nonsingular  matrices  and 
the  matrix  D2D3  has  simple  and  negative  eigen¬ 
values  -  wf,  i  *  1, 2, . . .,  m. 

There  is  no  restriction  on  the  dimension  n  of  the 
state  xeR".  Assumption  II  guarantees  that  high 
frequency  oscillations  will  occur  in  (3). 

As  an  example  of  a  system  in  the  form  of  (3),  we 
consider  a  mass-spring-damper  system  shown  in 
Fig.  1  where  the  spring  k ,  is  stiff.  A  set  of  convenient 


state  variables  for  this  system  is  the  position  of  the 
center  of  mass 

sc  =  (MIs1  +/Vf2Si  )/M,  Af  =  Ml+M2  (6) 
and  the  relative  displacement  between  the  masses 
Sj  =  Si-s2  (7) 


x^Ax  +  Bz,  .\-(r0)  =  x„  (3a) 

tiz  =  Cx  +  Dz ,  r(r0)  =  r0  (3b) 


where 


Our  analysis  of  (3)  does  not  require  the  matrices 
.4.  B,  C,  D  to  be  in  the  special  form  (4).  The  only 
assumptions  that  system  (3)  has  to  satisfy  are  the 
following: 

I.  The  norms  of  .4.  B.  C.  D  are  bounded  about  n 
=  0  and  the  state  r  is  of  even  dimension,  that  is. 
r 

II.  The  matrix  D  is  in  the  form 


where  s„  s2  are  the  positions  of  the  masses  V/,.  ,Vf 
The  equation  of  motion  for  this  system  is 


..  J\  .  /.‘V/2  .  fc,  fc,/Vf2 

Sc  +  .Vf5c+  M2  Sd  +  MSc+  M1  Sj~° 

A-Uo)  =  A„.  sl(r0)  =  i(|f0)  =  !C( 


Jj_ ,  ,  (fxMi  ,  J  z  M  V 

A/,-'  l XtyM  M ,  Mz)  Sj 

kl  k,M  /  ktM2,\ 

+m7s'+m^(1+^  h=0 

sj(to  1  ~sJo’  1 1  u ) =  f  j  l  r  o )  =  t'j„. 


(8) 


Since  the  spring  fc2  is  stiff,  we  define 

l  _  k2M 
H2~  \t\Mz 


(9) 


*The  matrix  I  denotes  an  identity  matrix  of  an  appropriate 
dimension 


such  that  ^  is  small.  In  the  state  variables 

Yi=s...  -V :  =  s.  =  t\ .  =  V/r. 

=  .VaP  =  c2,  n  (10) 
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(8)  becomes 


.  ki  /i  2  /c  i  iV/  j  f\M2 


Jf-i  =-2 

k,  /,  /,  2  ktMi\ 


//.M2 

j2m 

\JVf,  a# 

MyMi, 

which  is  in  the  form  (3)  and  satisfies  Assumptions  I 
and  II  with 

.  ,  kiM, 

Xm? 


3.  AVERAGING  OF  OSCILLATORY  STATES 

Before  analyzing  (3),  we  investigate  the  behavior 
of  the  system 

fiw^Dw  +  u  (12) 

where  D  satisfies  Assumption  II.  The  characteristic 
polynomial  of  D/fi  is 


-dnP'"0'  'M 
L -Dj./I  A/-f)J 

T  0  —  D-,,n  +  n[Xl  —  D4)DJ  l(A/  —  D, ) 

—  det 

L  -Dyfi  /.l  -  Di 

=  -  (  - 1  Tdet[/.2/  -A(04  +  DJ  ‘£<  D} ) 
-[D:D1-n1D*D;lDlDs);ti1l  (13) 

Let  T  diagonalize  D2D2  such  that 

TD1DiT~ 1  =  A 

= diag(  - wf .  - wi 

(14) 

and  rewrite  the  characteristic  polynomial  as 

tpi /.)=-(-  I  p det[A2/  —  R ,  A  -  (A  +  /rR,  )//r] 

(15) 

where 

R,  .riD^  +  Dj'D.Djir'' 

and 

Ri^TD^D;'  DiD}Tl. 


Expanding  the  determinant  in  (15),  it  is  readily 
shown  that  the  coefficients  of  A',  /  *0, 1, . . 2m,  are  of 
the  form  a(  (/1  )//i2*  " '  for  i  even  and  a,  (/1  )/#iJ"  "  *  ~ 1  for 
i  odd,  where  ti,(/i)  is  bounded  about  ^=0. 
Neglecting  n~R2  and  the  off-diagonal  elements  in 
R,,  (15)  becomes 

m 

(P(A)=  —  (  —  IF  fl  (a2  — 2(T(A  +  aif/^J)  (16) 

i  ■  1 

where  2 <r,  is  the  ith  diagonal  element  of  R,.  The 
coefficients  of  A1  of  (16)  are  also  of  the  form 
bi(n)jnim~i  for  i  even  and  for  i  odd, 

and  furthermore,  b^n)  approximates  at(n)  to 
Oin1).  Instead  of  (13)  <p(A)  can  be  expressed  as 

<p(A)=  -( -  ITdetfA2/  —  A(D,  +  D7 1  ) 

-{DiD2~n1DiD7'  D±D2),h:].  (17) 

Letting  S  =  TT0J'  where  T  is  any  nonsingular 
diagonal  matrix,  we  obtain  SD2D2S~l  Then 
the  diagonal  elements  of 

S<  £>,+  D2'  £>*£>,  )S'' 

are  identical  to  those  of  R,  and  (17)  can  also  be 
approximated  by  (16).  To  analyze  the  roots  of  <p(A) 
we  use  the  following  lemma. 

Lemma  1.  If  D  satisfies  Assumption  II,  then,  as  /i 
-*0>,  the  eigenvalues  of  D/fi  approach  infinity  as 

it  i  ±j(o,/H,  i=l,2 . m.  (18) 

By  Lemma  1,  as  /i—O”,  the  eigenvalues  of  (12) 
approach  infinity  along  asymptotes  parallel  to  the 
imaginary  axis.  Note  that  the  large  imaginary  parts 
of  (18)  are  the  consequence  of  solving  for  A  of  the 
quadratic  equations  in  (16).  If  some  of  the  eigen¬ 
values  of  D2Di  are  either  positive  or  not  simple, 
then  in  general  some  of  the  eigenvalues  of  D  u  may 
be  positive  and  0(1  >).  This  case  of  fast  instability 
is  less  realistic  and  will  not  be  considered  here. 

Due  to  the  eigenvalues  with  large  imaginary 
parts,  the  response  w(r )  of  ( 12)  will  in  general  consist 
of  high  frequency  oscillations  superimposed  on 
slowly  varying  dynamics.  Our  purpose  is  to  com¬ 
pute  this  slowly  varying  response  due  to  the  input 
u(t). 

Lemma  2.  If  D  satisfies  Assumption  II  and  if  11(f) 
=  u(r)-t-u(r )  is  an  input  where  u(r )  is  the  slowly 
varying  part  with  |ii|  and  jul^Ci  for  some  fixed 
c,  and  c:  and  il(r  I  is  the  oscillatory  part,  then  there 
exists  a  finite  T(/i )  such  that  the  slowly  varying  part 
u'(f )  of  u(f )  of  (12)  for  r„grg  T  is 

T  0  d;'1 

»V(M«- I  ,  q  ii(f)  +  0(/i).  (19) 
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Proof.  Integrating  the  variation  of  constants 
formula 

w(r )  *<$(r,  f0  )w(t0 )  +  ~  J;uO(r,  t  )u(t )  dt  (20) 

where 

<t>(r,r)=exp',D(i-r)/p;, 
by  parts,  we  obtain 

w(r)=  -D'lu(t)+<ft(r,r0)w(t0) 

+  Z>~‘d>(f,r0)“(*o) 

+  D'1  J;od>(t,r)u(t)dT 

+  ^JJ0d»(t,T)u(r)dT.  (21) 


the  input  and  w  as  the  output,  the  input-output 
behavior  of  system  (12)  is  that  of  a  lowpass 
wideband  filter.  Then  w(r)  is  the  dominant  part  of 
the  filter  output  which  shows  the  relationship  with 
the  usual  assumption  in  the  technique  of  averaging 
[4-6].  Thus  w(t)  approximates  w{t  )  closely  if  the 
high  frequency  component  of  w  is  negligible  or  if 
w(t)  is  used  as  an  input  to  a  slow  filter. 

4.  EIGENVALUE  AND  STATE  APPROXIMATIONS 
Letting  x  be  the  slowly  varying  part  of  x  and 
either  applying  Lemma  2  to  (3b)  or  setting  n  =*0,  we 
obtain  the  slowly  varying  part  i  of  z  as 

—D~xCx  +  0(fi) 

--£r‘Cx  +  0(^).  (26) 


But  the  first  integral  term  in  (21)  is  O(n)  since  a 
further  integration  by  parts  reveals  that  for  i0St 
S£T, 

I r  )t4(r )  dr|  g  n\  D  ~ 1  j  J  c ,  ( 1  +  jd>(r.  r„  )| ) 

t22> 


To  separate  completely  the  slowly  varying  part  z 
from  we  introduce  the  change  of  variables 

r?  =  2  +  D  ~ 1  Cx  +  nGx  sz  +  Lx  (27 ) 

and  determine  G  such  that  (3)  is  transformed  into 


We  also  note  that  u(r)  generates  high  frequency 
terms  and  the  terms  contributed  by  <J>(r,/0)  are 
approximately  of  the  type 

explorer  -  f„ )[  sin(aij(f  -  t0)/fi ) 
and 

exp  ;<x,(r  —  r„ )  J  cos(oj,(r  -  ru  )/> ),  i=  l,2,...,m. 


x  =  (A0-ixBG)x  +  Btj  (28a) 

fir}=*(D+iiLB)ri  (28b) 

where 

A0  =  A-BD-lC.  (29) 

Thus  G  is  required  to  satisfy 

-DG  +  (D-'C  +  )iG)Mo-I<BG)  =  0.  (30) 


Since 


D~ 


where 


MX, 


MX *  _ 


(23) 


X  |  =  —  (Dj  —  fi1  D±Di  1 D, )  1 D4D1  1 
X,-  -D;‘DJf4 

X^-Dl'D,X,  (24) 

X>--{D2-niD,D;'Dx)-'D,D;1. 


the  only  significant  slowly  varying  part  -  D~  'u(r) 
of  w(r)  in  (12)  is  approximated  to  0()t)  by 
— O'  ‘u(t).  where 


t> 


(25) 


implying  (19). 

This  analysis  justifies  a  simple  method  to  obtain 
wit ),  which  is  to  set  n  *  0  in  ( 1 2 ),  as  is  usually  done  in 
singular  perturbations.  However,  the  meaning  of 
setting  here  is  different.  Considering  11  *ii  as 


By  the  implicit  function  theorem,  the  solution  of  (30) 
is 

G  =  D'*C.40  +  0(/i) 

=*  D~lCA0  +  0{n)  (31) 


where 


Let 


4O  =  .4-B0~'C. 


(32) 


J  CB 

+  0|/(:) 


2  B, 
1 B . 


TfilD,  +  03  *  f  -  B  1 )  02  +  )I03  1 C  2 

lDx  +  iiD:lC,B,  mD^  +  Di'CJ 
+  O I  (i  ■ ) 

*[f;  '«> 


where 


B-[B,  B:].  C 


(34) 
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Then  the  upper  block  triangular  form  (28)  exhibits 
the  eigenvalues  of  (3). 

Lemma  3.  If  Assumptions  I  and  II  are  satisfied, 
then  the  eigenvalues  of  At>  and  5/p  are  an  0(p) 
approximation  to  the  eigenvalues  of  the  original 
system  (3).  Furthermore  as  p— CT,  the  eigenvalues 
of  5,p  approach  infinity  as 

P,  iM'/A  i  =  1, 2, . . m  (35) 

where  2pf  is  the  ith  diagonal  element  of  the  matrix 


and  its  inverse  is 

EM-i.  - 

The  original  system  (3)  rewritten  in  the  state 
variables  q  is  completely  decomposed  into  the  fast 
and  slow  subsystems 

C=A=  (41) 

(42) 


TiDt  +  D^B^D^T-'. 

The  second  statement  of  Lemma  3  follows  from 
Lemma  1.  The  meaning  of  Lemma  3  is  that  n 
eigenvalues  of  system  (3)  are  small.  They  are 
responsible  for  the  slowly  varying  dynamics  of  the 
system.  The  large  imaginary  parts  of  the  other  2m 
eigenvalues  are  responsible  for  the  high  frequency 
oscillations  while  the  real  parts  modulate  the 
envelope  of  these  high  frequency  oscillations. 

The  approximation  in  Lemma  3  is  purely 
algebraic  and  does  not  require  the  eigenvalues  of 
system  (3)  to  be  stable.  However,  it  can  be  used  to 
guarantee  the  stability  of  system  (3)  as  the  following 
observation  shows. 

Corollary  1.  Under  the  assumptions  of  Lemma  3. 

if  ,40  is  Hurwitz  and  p„  i  =  1.  2 . m,  are  negative. 

then  there  exists  a  p*  >0  such  that  system  (3)  is 
asymptotically  stable  for  all  pe(0,p*]. 

This  corollary  is  of  interest  when  feedback  control 
is  implemented  in  system  (3)  and  can  be  used  to 
separately  stabilize  the  slowly  varying  and  the  fast 
oscillatory  subsystems.  Such  control  laws  can  be 
designed  using  an  extension  of  the  methodology 
described  in  [10],  as  it  will  be  explored  in  a 
forthcoming  paper. 

To  separate  the  slowly  varying  part  in  x,  we 
introduce 


;=x  — p(CD~' -t-pNtysx— pH»)  (36) 

and  choose  such  that 


B  +  p(.4„  —  pBG)H  —  HlD+nLB)=0.  (37) 

By  the  implicit  function  theorem. 

,V  =*  4„BD ' 1  -  BD '  2CBD  * 1  +  Oin  I 
=  A0BB'l-BB--CBB-'  +  Gift  l.  (38) 


This  completes  the  transformation  (27),  (36)  which 
becomes 


1-nHL 

L 


-pH 

/ 


(39) 


where  =  A0-pBG,  ^  =  D  +  pLB. 

The  decomposition  (39),  (40)  is  an  exact  block 
diagonalization  transformation.  Neglecting  the 
0(p)  term  in  (41),  we  define  the  slowly  varying 
subsystem  of  (3)  as 

x  =  ,4„x,  x(f„)  =  x0  (43a) 

z*-B~xCx.  (43b) 

The  oscillatory  subsystem 

ni=B;.  ;U0 )  =  r0  +  0  "  1  Cx0  (44) 

is  obtained  from  (42)  by  neglecting  the  0(p2 )  terms 
in  9. 

The  state  approximations  achieved  by  the  sub¬ 
systems  (43).  (44)  are  stated  as  follows. 

Theorem  1.  If  the  original  system  (3)  satisfies 
Assumptions  I  and  II.  then  there  exists  a  finite  T(p ) 
such  that  the  states  of  (3)  are  approximated  to  0(p ) 
by  the  subsystems  (43),  (44)  for  r0£t:gT  that  is. 

x(r)=x(t)  +  0(p)  (45a) 

r(r)  =  f(r)  +  r(f)  +  0(p).  (45b) 

The  result  of  Theorem  I  implies  that  if  the  initial 
condition  jf(r0)|  is  much  smaller  than  |.v(r0)|,  then 
the  high  frequency  oscillation  can  be  neglected  and 
the  original  system  (3)  is  adequately  modeled  by  its 
lower  order  slowly  varying  subsystem  (43). 
Furthermore  the  subsystems  (43),  (44)  can  be  o  ed 
to  simulate  approximately  the  actual  response  of  ( 3 ). 
Due  to  the  presence  of  p.  the  ill-conditioned  (it 
+  2m)th  order  system  (3)  requires  a  prohibitively 
small  integration  stepsize.  However,  using  the  lower 
order  subsystems,  the  small  integration  stepsize  is 
necessary  only  for  the  2mth  order  fast  oscillatory 
subr  *m  (44),  while  the  integration  of  the  slowly 
vary.  .  bsystem  (43)  can  be  computed  with  a 
much  i-  ■  stepsize,  resulting  in  savings  of  comput¬ 
ing  time.  In  the  case  when  the  high  frequency 
oscillations  are  negligible,  only  the  integration  of  the 
siowly  varying  subsystem  is  required. 
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5  MASS-SPRING-DAMPER  SYSTEM 

We  illustrate  the  subsystem  decomposition  pro¬ 
cedure  with  the  mass-spring-damper  system  (11). 
Neglecting  the  i*  terms,  the  slowly  varying  sub¬ 
system  (43)  of  ( 11 )  in  the  original  state  variables  is 

i  =  i'„  sc(r0 )  =  sca 

,  *t  -  /l  -  -  , 

f.  -  vfA 

(46) 

N  =  0 

rJ=0. 


sf  =  s,  +  0(^)  f,  =  t'r  +  0(/i)  Q 

Sj  =  0(/r).  i'j  =  0(/t). 

6.  POWER  SYSTEM  EXAMPLE 
A  potentially  important  field  for  the  application  of 
this  methodology  is  in  power  systems.  In  transient 
stability  studies  of  interconnected  power  sys¬ 
tems^.  9],  coherent  machines*  are  usually  modeled 
as  a  single  unit  to  reduce  the  dimension  of  the 
problem.  We  now  interpret  this  coherency  idea  by 
applying  our  decomposition  procedure  to  a  three 
machine  system  shown  in  Fig.  2. 


Subsystem  (46)  represents  the  motion  of  the  center 
of  mass  as  if  V/ ,  and  M ,  are  connected  by  a  rigid  rod 
and  are  moving  together.  Intuitively  this  can  be 
explained  by  assuming  that  the  spring  restoring 
force  remains  finite  in  the  limit  as  k ,  —  x.  The 
displacement  sd  becomes  negligible,  that  is  the 
spring  becomes  a  rigid  rod. 

To  reintroduce  the  high  frequency  oscillations 
due  to  the  fact  that  fc2  is  finite,  we  consider  the  fast 
oscillatory  subsystem  (44) 

-;(fo  1 =  t'ao/P- 

(47) 


-n\ 


/iM2  ,  fzM 


,W,.W 


Since  the  spring  k2  is  stiff,  the  initial  displacement  sd0 
is  small.  In  the  spring  and  rod  analogy,  the  rod  is 
now  allowed  to  be  slightly  elastic.  Assuming  that 
forces  are  finite, :,  =  sd,  n1  is  not  large  and  is  actually 
properly  scaled.  The  same  property  holds  for  r, 
=  as  |sdj  =  uji-j|  due  to  the  high  frequency 
oscillations  in  sd.  We  rewrite  (47)  in  the  original 
variable  sd  =  n1zl  as  a  second  order  equation 


SJ  + 


/.W2  +  fi  M 


M{M  W,.W2 


s'd  +  —  s„=0  (48) 

P* 


that  is. 


M,.Vf,  , 

~sT~5i' 


+  Wl  + 


/.Ml 

.Vf: 


Sj  +  k,Sj  =  0.  (49) 


Equation  (49)  describes  the  motion  of  the  masses 
.V/,  and  .Vf2  connected  by  a  spring  k ,  and  a  damper 
)\  +/,  Mj,  M2.  Thus  our  decomposition  procedure 
shows  that  in  analyzing  the  high  frequency  modes, 
the  spring  A:,  can  be  neglected  while  the  damper/,  is 
reflected  through  the  connections  and  increases  the 
effective  damping. 

Thus  concluding  from  Theorem  1.  if  the  initial 
conditions  sd„  and  iu<,  are  of  O(^),  we  obtain 


Nil  *io 


_  0  02  6.0 

Q - tMUr^r 

; 

Mj*  01220  roo 

'2 


.0.3 

-VvVM— 


(Vj|  *1.05 


2  3 


”04  5  ,0.123  _ 

m — (D 

0.1444 

m2  >0.01193  *4c2/«**ct  rod 

3.75  .0 123  _ 

;  ^  fHHr - O) 

_  0.240’ 

Mj  *  0.01404  HC2/*«CT  rod 
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Fig.  2.  Three  machine  pover  system. 


The  opening  of  one  transmission  line  from  bus  1 
to  bus  2  causes  the  system  to  oscillate.  The  following 
post-disturbance  differential  equations  for  the  ma¬ 
chine  rotor  angles  may  be  written[ll] 

,vf  ,d,  =  p,.,  -  v",2  v, ,  cos  6 , ,  -  r,  v ;  y,  : 

x  cos(0)2  +t>2  -<5, ) 

I  J  F  3  y,  3  COS(0 ,3+1)3  c)  1  ) 

wX  =  P,.:-F;Jyi2costi:2-r,Fiy,: 

X  cos(t),  2  +d,  — (j2  ) 

—  K2  ir3  y,  j  cos(d23 +  t>3 —<)2 1  *51) 


•V/jdj-P  m,  -  f  32  I33  cos  H33  —  I' 1^3^13 

X  COSld,  J  +<),  -(5,1 
—  1  2  I  3)33  COS(  0  2  3  +  (5  2  —  d  3  ). 

The  notation  for  this  and  other  equations  of  this 
example  is  given  in  the  Appendix. 

If  y23  is  large  compared  to  V,  2  and  V,j.  then 
machines  2  and  3  will  be  strongly  coupled.  In  this 
case  it  is  convenient  to  rewrite  (51 )  in  terms  of  the 
variables 


\1  ,(),-(-  .V/  3d  , 
— — - 

\/2-.V/3 


<)23  =d2  -(>3  (52) 


•Two  machines  are  defined  10  he  coherent  if  the  difference 
between  their  ancles  is  sufficiently  small[8.  V] 
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as  a  fourth  order  system 


*  P..+  P,-.,  ~V?Y:l  cos  02 ,  -  K?  y33  cos  j3 

•>.,  — - — - Tl - 

_  Pj n,  ~  ^  l~  1  C°S  ^1  1 

V/, 

r,r,y,,  /  .v/3  .  .  \ 

\rrcosvi2~^rdii~dv 

/  m,  .  \ 


2v\v  3 

.v/ 


K» 3  COS  ^23  COS  (5 2 3 


(53) 


y  Pin.  —  ^  2**22  COS  fill  Pim—  1/3*V33  COS0jj 
=  - - - ‘ - - 

M:  i V/3 


y;r,y,,  A  .  M3  . 

— — -cos(0u-del-— O33 

/.  .  m 


V 

^^3^3 


/  „  .  M2  , 

cos  tfl3-^,+  — d 


M 


.Vf 


COSl'Pjj-^jj) 


33 


where  <),  is  used  as  the  reference. 

In  order  to  apply  the  decomposition  procedure, 
we  linearize  (53)  about  the  equilibrium  point  0",  and 
1)23.  The  linearization  yields  the  following  differen¬ 
tial  equations  for  the  perturbations  A <)cl  and  Ad23 


&>cl - at  l^cl  +a1JA^>23 

Ad-3  =U,,At)cl  — tl22A<j;3. 


(54) 


*1=*:.  *iUo)m*itto)  I 

*2  =  -U|  l*|.  X  >(to  )  *  .'C  2  ( r  0  )  j 
-l=«21*l  ) 

f:=0.  j 

Equation  (58a)  describes  the  oscillation  of  the 
center  of  inertia  of  machines  2  and  3  with  respect  to 
machine  1  and  is  identical  to  the  linearized  swing 
equation  obtained  by  regarding  machines  2  and  3  as 
an  equivalent  unit[8.9].  Since  machines  2  and  3  are 
relatively  weakly  tied  to  machine  1.  this  oscillation  is 
of  a  relatively  low  frequency.  Thus  assuming  that 
the  initially  A(j>3  is  small,  we  show  that  the  fast 
oscillations  are  negligible  when  only  the  slow 
dynamics  are  of  interest. 

To  recover  the  intermachine  oscillations,  we 
obtain  the  fast  oscillatory  subsystem  (44)  as 


(58a) 

(58b) 


—  ->•  -I  (  f  O  1  -  -1  (f<)  )  “  U;  1-X 1  (fy  ) 

M-2=— -!•  -  ’  (t|)  )  =  -  ’  Uo  )• 

(59) 

Equation  (59)  describes  the  oscillation  of  machine  3 
with  respect  to  machine  2.  Since  the  connection 
between  machines  2  and  3  is  relatively  strong, 
compared  to  their  respective  connections  to  ma¬ 
chine  1,  this  oscillation  is  of  a  higher  frequency  than 
the  oscillation  of  the  center  of  inertia  of  machines  2 
and  3  with  respect  to  machine  1.  Equation  (59)  will 
be  useful  when  the  intermachine  oscillations  be¬ 
come  significant. 

We  may  readily  solve  (58)  and  (59)  by  hand. 
Expressing  the  solutions  in  terms  of  the  original 
variables  gives 


In  the  case  of  strong  coupling  between  machines  2 
and  3,  a22  is  much  larger  than  cin,  a, ,  and  a2l. 
Hence,  let 


1 

~  —  A  2  2  • 

Defining 

v i  —  A<$f  |, x2  =  Aocj,  : |  =  A d23,  n', 
(54)  becomes 


(55) 


=  A<$:j,/l 

(56) 


x,  =  x, 

*:=  -an*. 

/*-!  =  -2 

H:2=u  2 1  -x ,  —  r  | .  ( 57 ) 

Equation  (57)  is  in  the  form  of  (3).  Setting  n  =  Q  in 
(57)  gives  the  following  for  the  slowly  varying 
subsystem 


A5c,  (r )  =  ucos  v  a,, :  +  6 sin  v  a, ,  t 
1  ^  •  1 

A<>23(t)  =  ccos-r  +  dsin-t. 

The  initial  conditions  are 


(60) 


AJcl  (0)=»  A^,  (0) 

AJcl  (0 » =*  o 

AO-3  (0 )  —  AO23  (0 )  —  /z  ”  ci  2 1  A()c  j  (0 ) 

aJ;3(0»=o 

where  the  n2  term  is  retained  for  improved  accuracy. 
Using  (61)  in  (58)  and  (59)  gives 


A<>  1  (f )  =  A<»  , (0)cos N  «,  1  r  162) 

A<?2  j  If )  =  [Ad ,  j  (0 )  —  /rti: ,  Ad, ,  (0 )]  cos  f. 


i 
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Now  by  applying  (45)  we  can  write 

Adc,(f)3Adcl(r) 

A<523(r  )3  A<523(r)  +  AJ23(r). 


(63) 


Substituting  (62)  into  (63)  and  using  the  fact  that 
AJ23  =  /t2a21A<itl 


yield 


A<5c,(t)  =  Adcl(0)cos  v  au  t 
Ad23(f)5/t2a2I  Adfi(0)cos  v  a, ,  r  (64) 
+  [A*23(0) 


-/t2a21  A<5C,(0)]  cos  -f. 


Finally,  we  recall  that 


i)..I(f)  =  <5"J  +  A<)cl(f ) 
d23(t)  =  <j23  +  Ad23(t). 


(65) 


Hence  we  may  write  the  following  solutions  for  the 
angles 


<jc,(f)3<)°i  +[<5C[(0)  — <>°,]cos  v  a,,  t 

<52j(OS^3+/<2a21[4i(0)-<5?i]cosv  au  t 
+  IC^ljlO)  — ^1}1  —  (<*a2lC^cl  (0) 

-KT.cosU  (66) 

From  the  numerical  values  given  in  Fig.  2.  the 
following  expressions  may  be  obtained 

itl(t)S  32.86°  -  1 8.75°  cos  8. 1 30f 
<)23(f  I  =  —  1.88°  +  0.3435"  cos  8. 1 30f  (67) 

-0.3235°  cos  26.02f. 

Note  that  (67)  is  expressed  in  electrical  degrees  since 
this  unit  is  in  more  common  use  than  electrical 
radians. 

Figure  3  shows  a  plot  of  <\.,(f )  as  obtained  from 
the  nonlinear  system  (53)  and  from  the  analytic 
solution  (67)  for  a  period  of  1  second  following  the 
opening  of  the  line  from  bus  1  to  bus  2.  Figure  4 
show  s  a  similar  plot  for  <j23(r )  from  ( 53)  and  1 67).  We 
note  the  excellent  agreement.  Of  course  this  result 
depends  on  the  fact  that  the  disturbance  applied  to 
the  system  caused  only  small  oscillations  of  the 
machines.  The  accuracy  of  the  time  scale  decom¬ 
position  is  much  better  than  it  would  appear  in  these 
curves.  The  error  indicated  is  mainly  due  to 
linearization.  Had  the  solution  of  the  full  linearized 
system  |57|  been  compared  to  the  time  decom¬ 


position  approximation  (67).  the  curves  would  have 
been  indistinguishable. 


6  CONCLUSION 

It  has  been  shown  that  singular  perturbation 
techniques  are  applicable  to  systems  which  possess 
slightly  damped  modes  oscillating  at  high  frequen¬ 
cies.  Our  analysis  procedures  consist  of  first 
identifying  the  small  parameter  /i  and  expressing  the 
system  in  the  form  (3).  Then  the  original  system  is 
decomposed  into  a  slowly  varying  subsystem  and  a 
fast  oscillatory  subsystem.  Using  these  subsystems, 
we  obtain  0</i)  approximations  of  both  the  eigen¬ 
values  and  the  states  of  the  original  system  (3). 
Beside  the  computational  advantages  of  dealing 
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with  the  lower  order  subsystems,  the  concept  of 
subsystems  contributes  to  the  understanding  of 
structural  properties  of  physical  systems.  The 
limitation  of  this  decomposition  procedure  is  that 
we  require  a  sufficient  separation  between  the 
frequencies  of  the  slowly  varying  dynamics  and  the 
fast  oscillatory  modes.  A  mass-spring  damper  ex¬ 
ample  shows  that  a  stiff  spring  can  be  regarded  as  a 
perturbation  of  a  rigid  rod.  the  imperfection 
resulting  in  high  frequency  oscillations  between  the 
masses.  In  an  inter-connected  power  system,  neg¬ 
lecting  the  intermachine  oscillations,  the  power 
angles  of  the  tightly  connected  machines  are  shown 
to  be  coherent. 


V.w,./  VW  w,/ 

(-+— ) 

/  i  i  ,  Vw  vf, / 

ft — r —  sin- 0... tan 4*, .» - - - tantf.. 

Vw  V/,/  '  /I  I  \ 

Vw  V/,/ 


Vw,/  Vw  w,/ 

(-L1 ) 

( t  i  V  ,  Vw  w,/ 

a-I  —  +  —  I  sin29,„tan4',,- - tan9,, 

Vw  W,/  /  I  t  \ 

Vw  ~  \Tj 
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V/tV;  /...  Vf, 


v.v.y,;  I  Vf,  V 

U"= 

v/iVj  (a,  w- .  ..  ] 

1 1  ;u.y,.  vi,  ,  w,  .  \ 

«u»-  - —sin  4',. - 

L  V/,,  Vf  \  Vf  ’ 


V  V  Vf,  , 

- - —  sinl  ■ 

V/,,  Vf 


21'  jk  j  1 

- >  m  cos  9. ,  sin  1)1, 
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APPENDIX 


notation  used  in  1 5 1 1 


ii,  :  rotor  angle  of  machine  i  in  electrical  radians. 

Vf,:  inertia  constant  of  machine  i  in  sec2  elect,  rad. 

P :  input  powei  to  machine  i  in  per  unit 

1  voltage  behind  transient  reactance  of  machine  i  in  per 
unit. 

per  unit  magnitude  of  the  i/th  element  of  the  reduced 
network  admittance  matrix. 

n  angle  in  radians  of  the  wth  element  of  the  reduced  network 
admittance  matrix. 


/  ,  W,  \ 

u.,  =  - - sinl  9, , - ol,  I 

L  Vf,  V  W  ‘  / 


J  vf,  \ 

- sinl  9, ,  -<>  |  -t-  I 

Vf,  v  Vf  ’  ’. 


’•»  1 

—  sint 

/  ' 

9 

1  Vf  ‘  ' 

V,V 

Vf. 

Vf , 

Vf  <m' 

norat  ion  used  in  1 53) 

Vf  -  Vf  .  A-  Vf, 


A-  - - 

Vf„ 


sin(4'„ 


f 


t 


I 
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Introduction 

Control  lymu  with  large  tad  small  Him  constants,  or  with  slow  and 
fast  modes,  are  frequent  in  applications.  A  modal  of  such  systems  is 


i>Ai,.x+A„s+  B,u  (1) 

lUmAitx  +  Attt  +  BiM  (2) 

where  x,z,  and  «  are  it.m,  and  r  vectors,  respectively,  and  the  scalar 
parameter  p  represents  small  time  constants.  If  js  is  neglected  and  (2)  ia 
replaced  by 


0-4„JP+,lBr+B1fl.  (3) 

and  if  A£*  exists,  then  the  substitution  of  I  into  (I)  results  in  a  reduced 
order  system: 

*-4„X  +  JoB  (4) 

where 

(5) 

In  the  deogn  or  time-optimal  controls,  this  order  reduction  is  motivated 
by  the  weB-known  difficulties  with  high -order  systems  which  are  constd-  where  /„  and  /„  are  the  *x  a  and  mxm  identity  matrices,  respectively, 
arable  even  in  the  linear  time-invariant  problems.  An  approech  to  We  note  that  (13)  is  a  special  case  of  a  transformation  due  to  Chang  [5). 
simplified  design  of  time-optimal  controls  is  the  quasi-optimum  techni-  The  original  system  (IX  (2)  is  finally  transformed  into 
que  by  Friedland  (I),  [2],  Also  related  is  an  averaging  approach  by 

Gerashchenko  tt  al.  (3J.  The  only  explicit  treatment  of  the  timeoptimai  (IS) 

control  for  a  singularly  perturbed  system  of  the  type  (IX  (2)  is  a  recent  . 

study  by  Coffins  (4),  whose  results  we  generalize  in  several  directions.  (I®) 

CoIBn.  use.  the  phme-cmonic  form  of  (IX  (2)  and  restrict,  his  deriva-  when  Gi  (HLBX  +  MBjX  i,-An-^LAxt. 

Hons  to  single-input  systems.  ...  ...  +  The  controUabiBty  properties  of  (IX  (2)  are  the  same  as 

W,  first  establish  that  the  controUabiUty  propwt.es  of  the  system  OX  propwtiw  *  (t5)>  (16).  ,utMystem  (l5)  „  ,  r^ufr  perturbation 
(2)  are  dmenmned  by  the  comroU.btl.ty  propert.es  of  the  slow  and  fast  ^  rc<hlced  tyMm  (4)  ^  nbtytteBU  (I3)  ^  (l6)  w 
subsystems.  We  then  demonstrate  how  the  fast-slow  separation  can  be  ^  ^  am«v«nt  revalues.  Them  facts  prove  the  follow. 

accomptisM  in  a  general  formulation  of  the  time-optimal  control  prob»  ^  theorem. 

**“•  Thtortm  I:  If  A£‘  exists  and  if 

CoNmotxAanjTY  or  Slow  and  Fast  Modes  rank[4o.Aofl*- •  •  ,A$_lB0J»fi  (17) 

An  interpretation  of  (3)  is  that  for  >«0,  the  slowly  varying  “steady  nnklBj.A aBt,  ■  ■  ■  ,A£~  'Bj]- m,  (18) 

state”  of  z  ia  x-  -  A£'A j,x.  To  separate  I  from  the  fast  transient  of  z,  a 

change  of  variables  is  used-  then  there  exists  p*  >0  such  that  the  system  (IX  (2)  is  controllable  for  aU 

pe(0,(s-]. 

1m*+A jj'42tx-f  pGxnz  +  Lx,  (6)  It  should  be  pointed  out  that,  in  view  of  (18),  a  matrix  K  exists  such 

that  An+BjK  is  nonsinfular.  Also,  the  controllability  of  (IX  (2)  is  not 
transforming  (I),  (2)  into  influenced  by  u-  Kz  +  v.  Thus,  even  if  A£'  doe*  not  exist.  Theorem  1 

Jl^1J(j)x  +  /l|ji|+  Bxy  (7)  **®  holds,  but  with  the  matrix  Aa  +  B^K  replacing  Aa  in  the  definition 

"  ‘  ’  (5)  of  At  and  Bo- 

Control  o»  Slow  Modes 

m-V*  rrawrad  M  4  me.  P.pw  *  d.  l.  cu™.  PTob,emi“*“  the  vtn‘W*  *  °*  **  V? (,)> 

at  dm  /eel  s-cs  Opt/aej  Spun  Cowauiua.  mu  *0111  »«*  neponetf  m  eon  by  the  (2)  from  an  initial  value  x°  at  /-O  to  zero  in  minimum  time  subject  to 

Jeon  Services  Peeawitw  Prawaa  (U.  S.  Army,  u.  S.  Nevy,  tedCr  S.  Ah  Paras)  under 
Cocmct  DAAeCT  TJ-COlSV,  sad  in  pen  by  tin  Air  Pons  Oittes  at  ScnaUflc  Research 
nedsr  Comet  APOeR-TO-l)70 

The  tethers  an  with  ibe  Dcpcrtetccl  at  El  tetri  cel  Pmeeries  tad  tka  CeordtaiMd  'A  fueetioert.)  it  Olp)  tf  there  «i»t  positive  eosttanup*  and  c  soak  that  tfca  am  I fl 
Ssteecc  Lakorawry.  Uatvaraky  of  tlHeote,  Urkaaa.  tit  tlHL  eetioflw  |/)  <cp  for  p>  (apU 
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te-A+(i<i*+f^4|i)q+(J,+ pLBx)tt  (I) 

where  Fm  ~  A  A- (A  jjWjj  4-  pC)  (Aq~  hA  ijC)  By  the  implicit  func¬ 

tion  theorem,  the  solution  of  F« 0  ia 

G-da*A„A0+ 0(|.).  («)' 

With  0,  system  (7),  (8)  is  block  upper  triangular,  and  hence  tve  have 

the  following  result 

Ltmma  1:  Suppose  that  A£‘  exists.  Then,  as  jt-sO,  the  first  a  ei¬ 
genvalues  of  the  original  system  (IX  (2)  tend  to  the  eigenvalues  of  the 
reduced  system  (4X  while  the  remaining  m  eigenvalues  tend  to  infinity  u 
the  eigenvalues  of  (1  /p\An. 

To  separate  the  slow  modes,  we  introduce 

im*-*{AltA£'  +  (10) 

and  choose  M  such  that 

An+,i(A'-fAXJG)H-H(An+tLAx3)-0.  (11) 

By  the  implicit  function  theorem. 

(12) 

The  transformation  (6),  (10)  can  be  written  as 


f  (  If  I.-*HL  -ptflfx 

UJ  l  ^  /-  II* 


and  its  inverse  is 


x1[  /.  '*"][« 

z  J  [  -t  f.-jsLff 


'■  ‘•dW.rrOJV'.  »AnMete«d)»-r. 
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|ut|  <  1,  I,-  •  •  ,r.  No  specific  requirements  an  imposed  on  the  van* 

able  x.  Its  behavior  is  of  interest  only  insofar  aa  it  can  impede  or  improve 
the  control  of  x.  The  minimum  principle  for  (IX  (2)  or,  equivalently,  for 
(15X  (16)  yields 

u--sjn|'ii»<“r-‘>+^r««r-'/''q|  (19) 

where  [p'.q'f  is  a  constant  («+«)  vector.  If  (Id)  is  asymptotically 
sublet  tr  i»  bounded,  f  aOfp)  at  r-T,  the  term  depending  on  (T-i/p) 
in  (19)  rapidly  decays  away  from  T,  and  hence  the  control  in  (19)  can  be 
approximated  by  a  “slow-mode  000001” 


£(T)  and  q( T)  in  terms  of  u,(t)  and  yr).  We  have 

d  T)-e*+*  { jr'e*-‘-'»«0u,(r)dr  j  +pj'e>**- 

’>«,yr)rfr 

where  r-  T-p9  and 

(23) 

q  (T)-e«*V  +  /tw-"9jy# 

(24) 

where 

v- y/-)+4 

(25) 

B--s*n{«ir4“r-,>p},  (20) 

which  is  a  time-optimal  control  for  the  slow  subsystem  (IS).  When 
then  do-r'f*  90-*£»  and  B  becomes  a  “reduced  control”  8»  that  is,  a 
time-optimal  control  for  the  reduced  system  (4).  In  applications,  x  is 
often  a  “parasitic”  variable,  that  is,  A^Aj^A^,  Bt  are  not  known  and 
the  only  dau  available  about  the  system  (IX  (2)  are  the  matrices  A^Bq. 
Then,  instead  of  B.  the  reduced  control  Bg  is  applied  to  (IX  (2).  To 
summarize  this  discussion,  we  define  systems  (IX  (2)  in  which  An  has  all 
the  eigenvalues  with  negative  real  parts  as  “robust”  systems. 

Lemma  2:  Suppose:  a)  the  system  (1),  (2)  is  robust;  b)  the  time- 
optimal  control  problem  for  the  reduced  model  (4)  is  normal;  c)  »«0  is 
reachable  from  x°.  Then  there  exists  p*>0  such  that  for  all  p 6f0,p*], 
the  slow-mode  control  B  is  a  near-optimal  control  for  the  system  (1),  (2) 
in  the  sense  that  it  steers  x  to  a  0(h)  neighborhood  of  zero  in  the 
slow-mode  minimum  time  T.  An  analogous  statement  applies  to  the 
reduced  control  fig  and  1%  the  minimum  time  for  (4). 

Control  of  Fast  and  Slow  Modus 

The  problem  is  now  to  steer  x°,xe  of  (1).  (2)  or,  equivalently,  f  °,?|0  of 
(IS),  (Id)  to  zero  in  minimum  time.  In  addition  to  the  minimum  principle 
condition  (19X  we  now  also  use  the  fact  that  the  Hamiltonian  is  zero  for 
all  r.  It  follows  that  (?/)»)- q  remains  finite  as  ji—0.  After  substituting 
B- M,  we  rewrite  (19)  more  compactly  as 

—  -sgn{x<r-t)+/(£^)j.  (21) 

For  x  we  assume  that  it  has  N,  zeros,  that  they  are  distinct,  and  that  they 
are  located  in  a  subinterval  [0,r,J  of  the  interval  (0,  T],  Then  r  +  0(u)  also 
has  ,V,  zeros  and  they  all  lie  in  0(  p)  neighborhoods  of  the  corresponding 
x  zeros.  We  recall  that  in  a  robust  system,  /  exhibits  a  rapid  exponential 
decay.  Thus, /<0(ft)  in  (0,1,  J.  Hence,  g «x+/«x+ Ofp)  has  Af,  zeros  in 
[0,/,]  and  they  lie  in  0(p)  neighborhoods  of  the  corresponding  zeros  of  x. 
These  M,  zeros  determine  the  “slow”  switchings  of  the  control  (21).  At 
the  end  of  the  interval  (0,  T\,  there  is  a  subinterval  (r^T]  in  which  /  is  not 
negligible  and  g  may  have  Nf  additional  zeros.  In  view  of  the  rapid  decay 
of  /,  intervals  [0,t,|  and  [i^T]  are  disjoint,  t,<iy,  and  T-tf-Q(p).  The 
additional  Nf  zeros  define  the  “fast”  switchings  of  the  control  (21)  and 
are  to  be  determined  in  a  fast  time  scale  om(T-t/p).  We  assume  that 
the  zeros  of  r(0)+/(«)  are  distinct  Since  x(  (io)+/(o)-x(0)4- /(«)+ 0(  jt), 
we  see  that  if  a'  is  a  zero  of  x(0)+/(o),  then  T- plo'+0(p)l  i*  a  zero 
of  s(T- r)+/(T- t/p).  These  facts  are  summarized  as  follows. 

Theorem  2:  Let  (I),  (2)  be  a  robust  system  and  z-0,  :«0  be  reach¬ 
able  from  x°,r°.  Suppose  that  the  zeros  of  r(T- r)  as  well  as  the  zeros  of 
r(0) ■*■/(«)  are  distinct  Then  there  exist  u*  >0  and  9  >0  such  that  for  all 
p€(0.e*].  the  time-optimal  control  (21)  is  separable  in  the  following 
sense: 

-('<'>■  m 
(  yr),  0<  r<9 

where  r«f-«  and  the  switchinp  of  u,(r)  are  in  0(p)  neighborhoods  of 
the  zeros  of  x(T-r)  and  the  switchinp  of  yr)  are  in  0()i)  neigh¬ 
borhoods  of  the  zeros  of  x(0)+/(#-r). 

To  interpret  and  exploit  this  important  separation  property,  see  express 


is  the  value  to  which  u,(i)  steers  tj  after  its  last  switching;  see  (16).  In 
view  of  the  rapid  decay  of  the  i)  transient,  &  is  an  exponentially  small 
term  and  will  be  neglected  henceforth.  From  (24)  and  (25X  an  interpreta¬ 
tion  of  yr)  is  that  it  steers  q*  to  zero  in  minimum  time  r»f.  On  the 
other  hand,  it  is  clear  from  (23)  that  the  contribution  of  yr)  to  «T)  is 
0(  p).  Thus  11,(1)  steers  £  to  a  0(  p)  neighborhood  of  zero.  This  means  that 
y  t)  can  be  approximated  by  the  slow-mode  control  B  or,  even  simpler, 
by  the  reduced  control  Bg  (see  Lemma  2).  From  Theorem  2  we  know  that 
yr)  can  be  approximated  by 


yT)--sgn  {<3&;e**»-’>$  +  s(0)}  (26) 

where  q  is  to  be  determined  such  that  ij*  for  (16)  is  steered  to  zero.  As  a 
further  simplification,  8?,  ®2  tn  (26)  can  be  replaced  by  AU,BV  respec¬ 
tively. 

In  conclusion,  to  obtain  a  near-optimum  control  for  (I),  (2X  we  first 
calculate  the  time-optimal  control  Bg (/)  or  fl(t)  for  the  reduced  order 
model  (4)  or  for  (IS).  Then  we  use  i|*  as  the  initial  condition  for  the  fast 
subsystem  (16)  and  evaluate  the  fast  control  fi^r)  from  (26)  to  steer  the 
state  of  this  subsystem  to  zero.  This  control  is  near  optimum  in  the  sense 
that  the  error  in  £fT),  g(T),  and  hence  in  x{T),  z(T),  is  Ofp). 

It  is  possible  to  further  correct  the  slow  control  by  selecting  y  f)  as 
the  time-optimal  control  for  steering  £  from  £°  to  {(»)“- 
pfie-'+’%tyT)dr»-pC,  as  seen  from  (23).  To  obtain  a  correction 

u,(t)-fl(r)  +  «y(r)  (27) 

let  iv  and  be  switching  times  of  fiy  and  (u,)y,  respectively,  and  let  1  and 
p  be  the  corresponding  final  time  and  co-state  vector  for  the  corrected 
control.  Then  we  may  write 


‘V*ip  +  Pt'v 

tm  T+pT' 

pmp  +  pp-, 

(28) 

**-1 

\  +  0 <(/-iv)<p/v,  for/g>0 

I _ /  -  \  .  /  •  \  _ 

(29) 

then 


The  corrections  in  the  switching  times  become  approximately 

•qmT'*p'Cj(t\)[p ^c,(»;)]  ’  (30) 

where  c,  is  the  ;th  column  of  e4,<r~M|$0.  The  substitution  of  (28),  (29). 
and  (30)  in  (23)  results  in  the  following  set  of  linear  equations  for  p  and 

r. 


-r-r*0fl<r)- 


r+- 


F<V,(v) 


(31) 


The  solution  of  (31)  together  with  (30)  and  (29)  yields  the  corrected 
control  u,(r).  The  resulting  errors  it)  &  T),  and  hence  in  x(TX  become 


0(11*).  Sine*  no  corraetioo  it  applied  to  tbt  error  in  t|  and  t  remain 
0(n);  however,  it  decay*  to  zero  very  rapidly. 

Examflb 

In  moet  dc  motor*,  the  mechanical  time  constant  it  large  compared  to 
the  electrical  time  constant.  Let  u  and  i  be  the  speed  and  armature 
current,  respectively;  then 

t-  7--T'  <”» 

T2“-T“-,+  ji  (33) 

where  the  armature  voltsfe  u  it  the  control  We  introduce  rmm\f.B/J)+ 
(KrK./JK)\-'  and  h-(L/ RtJ.  Then  (32),  (33)  in  the  new  time  scale 
r'  -  t/rm  become 

i"”T+7Jt+T+*X  (34> 


this  approach  to  the  time-optimal  control  problem  hat  revealed  similar 
time  scale  separation  properties  of  linear  time-optimal  control*. 

The  thn*'tirtle  separation  property  it  shown  to  be  particularly  useful 
in  a  near-optimum  design  procedure,  which  can  be  divided  into  two 
lower  order  phases,  corresponding  to  the  design  of  a  slow  mode,  or  a 
reduced  control,  and.  in  a  different  time  scale,  a  fast  control 
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lljoo -—x-t  +  bu  (35) 

*1 

where  xmu,zmi,klm(Kr/ B\kmkt(K,/  R),bm(l/ R).  We  seek  the 
time-optimal  control  to  steer  both  speed  and  current  to  zero,  that  is, 
HT)-i,(T)-Q.  The  control  of  the  slow  mode  is 


fl(r)  —  «,(/)—  -sgnt®.  0  <i<T 


The  error  in  &.T)  is  obviously  zero,  but  the  final  value  of  <|(T)  and  the 
miss  distance  for  x(  f)  are  given  by 

h(  f)-(i|#+  ^sgnt0)*-^'-  £«gn<0-  -  (37) 

z(r)--p*,(lAC)T|(r)-)a:,(1^--^sgnf0  (38) 

where 

«o-(  1  -  pX)".  «i“(  I  ~  (•*).  »o-  ^  [  l  +  ] 


c-Ml-(*X),d-I(l-M),-Ml 


*-(-ife){4  77  } 

1  v  c^)('-mf)  1 


The  fast  variable  may  now  be  controlled  by  using  the  control  B/t) 
-sgnt".  0< r < B—(l/d])ln2.  The  exact  miss  distance  in  {(T)  at  T 

«r)-(l-«--"'Asgn<o-0(M>.  (39) 

«o 

which  is  the  same  as  the  miss  distance  in  x(  T)  since  e(  T)  is  negligible. 
The  slow  control  may  now  be  corrected  for  this  miss  distance. 
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A  Rfccnti  EfutloQ  for  Block-Dingoaniiznfion 
of  IU-CoodftkMied  System 


PETAR  V.  KOKOTOVIC 


Abmrooci — A  i 


Introduction 

In  this  note  we  discuss  a  method  to  transform 

UHS;  2][s] 

into 

[>;]-[•  *][s] 

and  into 

where  a,  and  y,  are  e^vectors,  and  x1  and  y1  are  rij-vacton.  The 
transformation  is  particularly  convenient  for  systems  possessing  n,  small 
and  a,  large  eigenvalues,  when  (2)  and  (3)  can  be  used  to  separate  the 

Mil— tpt  r— — *  Jim  2*  1975.  Thu  wort  — —  — ppomd  is  pan  by  thi  Jo— I 
*•** c—  Elect—  Preps-  sad-  Coetract  DAAB4J7-72-C025*.  the  U2.  Air  For— 
sad— Oriel  APOBR-TS-ZSTO.  iad  tbs  Nibeaal  get—  Foaadaboa  sad—  Orsai  ENG 
7*20091. 

Thi  tutor  ie  with  l—  Depart— t  of  EJectnoW  (— —  tad  Coordieaied  - - 

upon  Dry,  U-eenby  of  nUaoM.  Uibu*  IB.  *1101.  wa- 


Conclusion 

The  controllability  properties  of  the  original  system  are  determined  by 
a  separate  analysis  of  the  slow  and  fast  subsystems.  An  application  of 
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TOCHMCAL  NOTVS  AND  CO«M»OND«NC* 


“slow”  ud  “fait”  subsystem*  of  (1).  la  ibis  contest  the  traaafoonatioa 
has  beta  introduced  by  Chang  [11  [2]  to  study  singularly  parturbod 
systems  and  it  was  also  applied  to  aa  optimal  control  problem  [3],  The 
conditions  obtained  here  for  time-invariant  systems  are  lest  restrictive 
then  those  in  (11  [2|  aad  the  system  (1)  need  not  be  singularly  perturbed. 
Instead,  it  is  sufficient  that  the  norms  of  its  subtna trices  satisfy  an 
inequality.  In  the  course  of  the  proof  of  this  result  a  convergent  iterative 
procedure  is  derived  for  calculation  of  the  transformation  matrices. 


Tin  Riccati  Equation 

To  transform  (1)  into  (2)  we  use 

y2-x2+Lx,  (4) 

aad  require  that  the  s,xs,  matrix  L  be  a  reel  root  of 

AffL  —  2d4||  +■  LA  |2Z.  “'fji  “0.  (3) 

If  L  exists  then  the  substitution  of  (4)  into  (1)  yields  the  block-triangular 
system  (2)  where 

Ei*dn  — (6) 
A-j2+  LA  (2-  (?) 

Assuming  that  An  is  nonsmgular  we  introduce 

and  seek  L  in  the  form 

f.-Lo+D  (9) 

where  D  is  a  real  root  of 

DAq  (tj2+ LqA  (j)H~  DA  0.  (10) 


The  following  lemma  gives  a  sufficient  condition  for  the  existence  and 
uniqueness  of  a  real  root  D  aad  establishes  a  bound  for  its  norm  ||0||.  It 
also  formulates  a  convergent  procedure  for  iterative  calculation  of  D. 
Lemma  1:  If  Aa  is  nonsingular  and  if 

IMw'H  <  y  (Moll +  M  uH  II  Asil)~ 1  (ID 


then  a  unique  real  root  of  (10)  exists  satisfying 


0<||/>l|< 


^MojllUog 
Moll +  Mull  lie# 


(12) 


This  root  is  an  asymptotically  stable  equilibrium  of  the  dilference 
equation 


0**i“4al(2Mo+  AMo-  AMuAs  )*/(At )  (13) 

and  its  domain  of  attraction  encompasses  the  set  of  matrices  defined  by 

(12). 

Proof:  For  a-|M„||,  b - \\A ,2||  || Z,||.  c-MS'll  sod 

^  MoHll^oH  (M) 

we  obtain  from  (13) 

d,*,<c[l-»-(e-t-h)i4  +  aHJ)<c(^dit-l)1  (15) 

and  we  analyze  the  upper  bound  of  dk  defined  by 

sU.-c^^l)’  (Id) 


Obviously  dkaik  for  all  *.  Whan  c<[(e  +  6)“'  then  the  scalar  dif¬ 
ference  equation  (Id)  has  two  real  equilibrium  points  d’  and  d" > d'  aad 


d'  lies  in  the  interval  [0,  2(a+6)-1].  For  all  e^md'  in  this  interval  we 
have  &+ ,  -  d'|  <  &  -  d'\,  which  proves  that  Dk  is  bounded,  that  is 

0<K||<2(a+W''  (17) 

holds  for  all  1,  2,-  •  •  ,if  it  holds  for  km 0.  Substituting  tDk~ Dk-  D 
into  (13)  we  get 

SDk+,-Aai{tDk(A0-AliD)-(L0+D)A  l3tDk  -  SDkA  t3SOk  )  (IS) 
which,  using  ||aAkll*so4<||Z>4||  +  ||2>l|,  implies 

«*♦ ,  <  c[a  +  6  3  \\A  ,2||  HD  ||  + 1  \A  „|| #  A*||)o*.  ( 19) 

When  both  l|D*||  and  ||f>||  satisfy  (17),  then  (19)  yields 

<*k+i  <  e^o  +  6+  Oe(e+b)«h  (20) 

and,  hence,  if  e<[(a+ h)-1,  as  required  by  (II),  then/(/>t)  in  (13)  is  a 
contraction  mapping  aad  D  is  its  fixed  point.  We  complete  the  proof  by 
noting  that  ok  is  a  Lyapunov  function  and  ot+,-ot<0  for  all  Dk 
satisfying  (17). 

Using  (13)  with  the  initial  condition  O0“0  we  can  calculate  D 
iteratively.  By  (11)  and  (20)  after  k  iterations  the  relative  error  is 

«(3M£'ll(Moll  +  Mull  II A>ll)]*  (2D 

and  it  decreases  as  ||A£l||  and  ||A0||  decrease,  that  is  as  the  ill- 
conditioning  of  the  system  (1)  increases. 


Blocx-Diaoonauzation 


To  further  transform  (2)  into  (3)  we  use 

y,-x,-My2 

(22) 

where  the  n,  x  n2  matrix  M  is  a  real  root  of 

i,Af  —  MB2  + Ai2«*0. 

(23) 

The  following  lemma  formulates  a  convergent  iterative  method  for 
solving  (23). 

Lemma  1:  Under  the  conditions  of  Lemma  I  the  solution  M  of  (23)  is 
the  asymptotically  stable  equilibrium  of  the  linear  difference  equation 

kdk4.  |  “•[Mu  —  A \jL)Mk  ~~  MkLA  ul^u'  *4 iMh*-  (24) 

Proof:  For  <nk  ■“  ||  Adk  -  Af  ||  we  obtain  from  (23)  and  (24) 

m»*,<c[a  +  6  +  2M,jlll|2)||]m»  (25) 

and,  by  virtue  of  (12), 

m*,,<e^«  +  b+^2L  jm4.  (26) 

Thus,  »"*♦,<  "»*  if  c<J(o  +  b)''  which  is  satisfied  by  (11). 

To  summarize,  the  transformation  of  (1)  into  (3)  is 


where  /,  and  /2  are  the  n,-  and  n2-dimensional  identity  matrices, 
respectively.  The  transformation  (27)  is  performed  in  two  stages.  (4)  and 
(22). 


Concluding  Rxmajuu 

In  applications  L  can  be  calculated  from  (9)  and  the  iterative  scheme 
(13).  It  is  somewhat  simpler  to  program  the  equivalent  iterative  scheme 
for  (5)  with  the  initial  value  Lg  as  in  (S).  In  several  tests  with  matrices 


1 

1 

I 
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satisfying  (1 1)  an  accuracy  of  four  significant  digits  was  achieved  after 
only  two  iterations,  indicating  that  (1 1)  is  a  conservative  condition.  An 
example  when  (11)  is  not  satisfied  is  a  power  system  model  developed  in 
[4,  pp.  104-106]  whose  matrix 


-0.11 

0.02 

0.03 

0.00 

0.02 

0.00 

-0.17 

aoo 

0.00 

0.17 

0.00 

2.00 

-4.00 

0.00 

0.00 

-4.00 

aoo 

0.00 

-2.00 

0.00 

0.00 

0.00 

0.00 

4.75 

-5.00 

with  «|  *2,  it j-3  and  the  absolute  value  norm  yields  a* 0.676, 4- 0.968, 
and  e«  1.425,  seven  dines  larger  than  in  (11).  After  four  iterations  the 
accuracy  better  than  four  digits  has  been  achieved  and  the  eigenvalues 
- 0. 1553* £/).  11466  of  B„  and  -5.0273,  -3.9938,  -1.9482  of  8 j,  are 
within  S 0.00005  of  the  eigenvalues  of  A.  Thus,  the  method  can  be  used 
even  when  lemma  1  is  violated  When  (1 1)  is  satisfied  rapid  convergence 
can  be  expected 
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RsnasNcas 


This  correspondence  extends  the  notion  of  sensitivity  to  the  case  of  a 
parameter  whose  variation  changes  the  system  order.  Using  the  expres¬ 
sions  derived  here  it  is  possible  to  analyse  modes'  sensitivities  with 
respect  to  neglected  parasitics  and  to  the  fast  inodes  eliminated  from  a 
reduced  order  model. 

The  change  of  system  order  is  parametrized  by  writing  the  system 
equation  in  a  singularly  perturbed  form  (7]>  that  is, 

x  —  Ax  +  Bz  (1) 

ci-Cx  +  Dr  (2) 

where  the  small  positive  scalar  r  is  of  the  order  of  the  ratio  of  speeds  of 
slow  and  fast  modes.  When  r  is  set  equal  to  0,  that  is  when  the  transients 
of  the  fast  modes  are  assumed  to  be  instantaneous,  then  the  substitution 
of  r  from  the  quasi-steady-state  expression 

0-Cx  +  f>*  (3) 

into  (1)  yields 

xm(A-BD~lC)x±AtX.  (4) 

This  is  the  reduced  order  model  frequently  used  as  an  approximation  of 
(I)  and  (2%  Considering  c-0  corresponding  to  the  simplified  model  (4) 
as  the  “nominal”  value  of  r,  we  now  investigate  how  the  eigenvalues  and 
eigenvectors  change  when,  instead  of  0,  t  has  a  small  positive  value 
corresponding  to  the  exact  model  (1)  and  (2). 
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Eigenvalue  SENsmvmBS 

It  is  shown  in  [6],  (7]  that  the  models  (1)  and  (2)  can  be  transformed 
into  the  block  diagonal  form 


x,-S(«)xa 

«**-9(c)x. 


(5) 

(O 


where 


a^-Ao-rJO-^o-t-Ofr2)  (7) 

9(c)-Z>  +  tf>-'a»+0(e2).  (8) 

We  rust  consider  the  eigenvalues  \  of  S(c)  and  denote  by  u,  and  v,, 
such  that  0,^*1,  the  eigenvectors  of  d(c)  and  of  its  transpose  fi'(c), 
respectively.  Using  the  well-known  ( 1],  [3]  eigenvalue  sensitivity  expres¬ 
sion 


3X,  ,  3(2 


(9) 


Elgensensitirtties  in  Reduced  Order  Modeling 

J.  J.  AIXEMONO  and  P.  V.  KOKOTOVIC 

Atttrmct — Expraasfcmt  for  ilgsTahn  aad  elgeneeder  seneNhidee  am 
derived  with  reepecr  to  the  singular  partuthadou  peremeter  wheat  reriedon 
deagn  the  rystem  order.  They  am  IBuetnMed  by  the  sauaWrity  of  a  power 
tymtm  mkW  wkk  rMpict  to  Us  ntgioctod  fMt  pm 

INTRODUCTION 

For  almost  two  decades  eigenvalue  end  eigenvector  sensitivities  have 
been  among  the  most  common  tools  in  circuit  and  system  analysis 
[»H5J.  They  am  used  to  determine  influence  of  system  components  and 
parameters  on  individual  modes. 

Ma—acrtpc  rmmroA  Nonabo  I*  t*7».  Thi»  wort  w*»  wpponad  ie  perl  by  ibe  Mel 
Urhom  Dactwe  rmpaaa  (US.  Army.  US.  Nevy,  aad  US.  Air  Pom)  u&dcr  Coo  tract 
NOOOI*-7WC-oa24.  ia  pert  by  tbe  US.  Air  Fom  ueder  Oraat  AFOSR-7S-M33.  aad  ie 
pan  by  tbe  Dtvtaaoa  of  Etocwta  Eeorfy  Syaaaaa  cedar  Coo  tract  EC-77 -C-OS-JW*.  Tbit 
papar  waa  pneamed  at  iba  IJtb  A  Alomar  Coefaraeea  oa  Circuit*  Syitama,  aad  Coo- 
paaara.  Pavtfi.  Ore*  CA.  Nov.  5-7.  1*7*. 

J.  I.  Alaeaai  ■  wttb  Aaaartaae  Eioama  Fowar.  Now  Tort.  NY  1000*. 

F.  V.  Kobeaovta  a  wttb  iba  CoordWemd  Sciaeee  Ubcreaooy.  Uaavantty  of  ItUaot* 
Urtoao.  1L  *IMI. 


and  evaluating  3d /3c  from  (7)  we  obtain 

WBD-tCu, .  (10) 

Analogously,  for  the  eigenvalues  ^  of  9(c),  with  qt  *od pj%  fa- 1,  being 
the  corresponding  eigenvectors  of  9(c)  and  9  '(c),  we  obtain,  in  view  of 
(8). 

3|*  I 

o» 

The  expressions  (10)  are  the  actual  sensitivities  of  those  eigenvalues  of 
(1)  end  (2)  which  remain  rutile  u  c— 0.  The  remaining  eigenvalues  p,/ c 
tend  to  infinity  as  <— 0  and  expressions  (II)  are  the  sensitivities  of  their 
asymptotes. 

Eigenvector  Sensitivities 

Differentiating  (2v,  “\u,  and  evaluating  the  derivatives  at  c«0  we 
obtain 

(A0-X,/)^i  (12) 

Following  (3]  and  assuming  that  the  eigenvalues  are  distinct  this  expras- 
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TABLE  I 

Ekmnvalum  and  Stssmvms  or  (17) 


Exact 

Uncorrectad 

Corrected 

Sensitivity 

-0J62  XjM 

-0.4ty.5l 

-0 JSStyJS 

0.044 ty. 02 

-3.93 

-J.72 

-3.95 

-0-23 

-a.53i;sj2 

-S.29ty7.95 

-S.50tyS.23 

-0.21ty.28 

-o.Miyi.37 

-0.7Styl.39 

-asstysjs 

-o.o7ty.oi 

i  can  be  reduced  to 


nod  0,  -0.  Similarly, 


and 


§-2*«e. 


A.  -  , 

*ikm  A^'-A,0* BD'^Cu, 


**•/ 


*Jkm^0^),kCH 


Example 


ma  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  AC-25,  NO.  A  AUGUST  1900 


Rmuai 

[1|  D.  K.  FMw  ud  V.  N.  Fidwt,  C«pwMM  MUM  ^  Uwr  AM*,  ha 

Francisco,  CA.  Frumis,  IMS. 

(Si  I.  *.  Cm.  St.  E4.  Syn am  Sw«in«o»  Amtttu.  ScwANtl.  PA:  Dacha. 
Huichiaaoa  and  Row,  1973. 

[3)  B  Pod  at  tad  It  Ooaalay,  A/adat  CcaarW.  New  York:  Taylor  and  P ranch.  197}. 
[4|  3.  E.  Vaa  Nam.  J.  M.  Boyle,  and  F.  P.  laud,  ~S— aviHm  at  Urpa,  araloplc  leap 

coairol  ayaurna,*  IEEE  Tram.  A  worn*.  Cam.,  voL  AC-10,  PP-  3M-3IS.  IMS. 

(5)  F.  I.  Nolan.  N.  K.  Siaha.  and  R.  T.  H.  Aldan.  “Eiemwlw*  tanaatmtase  at  power 
ayaiama  iadndtes  network  and  akalt  dynaaeaca.*  IEEE  Thank  Fewer  dap  Star..  voL 
PAS-95,  pp.  ISIS- 1324,  197*. 

(4)  J.  J.  Adamoea  "A  ainaolar  parturkataoa  appaonck  to  power  ayaiana  dynamise." 
FhJ3.  liiaanakna  Unav.  of  Ktmoaa.  Urbane.  197*. 

[7]  F.  V.  Kofcowvie.  J.  J.  Allaanonn,  J.  R.  Winkalman,  and  I.  H.  Chow.  Tinpalar 
partnrbadom  and  Kaandva  aeparataon  o#  time  acalea,"  A eiaetaWra.  voL  Id,  Jan.  19*0 


-0.5S 

0 

0 

-027 

0 

0_2 

0 

-1.0 

0 

0 

0 

1.0 

0 

0 

-5.0 

21 

0 

0 

0 

0 

0 

0 

377 

0 

-0.14 

0 

0.14 

-0.2 

-0.28 

0 

0 

0 

0 

0 

0 

0.08 

-173 

66.7 

-116 

40.9 

0 

-66.7 

The  matrix  appearing  in  a  seventh-order  model  of  a  synchronous 
machine  connected  to  an  infinite  bus  [6],  [7]  is 


ic 

a  « 


whom  A  is  2x2  and  O  is  5x5,  that  is,  the  simplified  model  (4)  is  of 
second  order.  In  this  case  me  scale  the  fast  modes  by  r-0.1.  Note 
however  that  the  approximations  such  as 

\(c)«\(0)  +  «^  (II) 

do  not  depend  on  this  scale  factor  since  the  sensitivities  am  scaled 
correspondingly.  In  Table  I  me  give  the  approximations  of  the  type  (It) 
for  all  the  eigenvalues  of  (17).  The  columns  from  left  to  fight  are  the 
exact  *i  gen  values,  the  uncorrectad  eigenvalues  of  A0  and  1/cZ),  the 
corrected  eigenvalues  of  (17)  and  their  sensitivities,  (t  should  be  noted 
that  the  errors  of  10  percent  or  more  have  been  reduced  to  less  than  2 
percent 

Conclusion 

When  the  change  of  system  order  is  parameterized  using  singular 
perturbations  the  tigenaensitivities  with  respect  to  this  change  can  be 
evaluated  from  the  expressions  analogous  to  the  usual  expressions  for 
sensitivities  with  respect  to  parameters. 


SUBSPACE  ITERATIONS  APPROACH  TO  THE  TIME  SCALE  SEPARATION' 


B.  Avramovlc 

Decision  sod  Control  Laboratory 
Coordinated  Science  Laboratory 
University  of  Illinois 
Urbane,  Illinois  61801 


abstract 


R(L)  •A22L-Uu  +  LA12L-A21-0  (8) 


Sons  properties  of  the  tine  scale  separation  are 
reviewed  and  a  new  globally  convergent  algorithm  is 
proposed.  A  connection  between  the  new  algorithm  and 
the  existing  Rices tl- like  algorithms  is  established. 


BASIS  FREE  IW  SCALE  SEPARATION 


After  introducing  necessary  notation  we  will  state 
basic  properties  of  the  tine  scale  separation.  Ue  use 
\^(A)  to  denote  1-th  eigenvalue  of  A  and  we  atauae  that 

lAt(A)l  »Ut+lCA)l.  1*1.2 . .  (1) 

The  spectrum  of  A  is 

3(A)  •tkl(A)i,  1*1,2 . n).  (2) 

Then  the  problem  of  the  tine  scale  separation  for  a 
system  k«Ax,  x€Rn  partitioned  with  given  n^adlmx^ 

ae 


(3) 


and  the  matrices  in  (4)  are 


Bl“All‘A12L 

82-A22+“l2 


(9) 


Conditions  on  existence  of  L  and  let  explicit  form  are 
given  in  the  following  standard  result  [see  e.g.,  7, 
11] ,  rephrased  here  in  a  basis  free  form. 


Given  (1)  and  an  admissible  n^,  let  oQ  • 
(lxt(A)|,  i  -  l,2,...,n,}  be  the  dominant  spectrum  and 
let  4  be  the  dominant  eigenspace  of  A.  Further, 


let  the  columns  of  a  matrix 


€r 


be  a  basis  for 


4.  Then,  provided  is  nonsingular,  the  solution  of 
(7)  satisfying 


°<V“aD 

(10) 

.1 

L’-Vf* 

(11) 

is  to  find  a  transformation  yielding 


(4) 


with  Che  spectrum  of  A  separated  into  3(8,)  and  3(B2) 
such  that 


_  aup  o(B2)  IXnl+l(A)l 
1  *  inf  oi'Bj)  "  Ia0\a)|  <  l’ 


Every  n^  satisfying  (5)  will  be  called  admissible.  Ue 
remark  that  the  formulation  (5)  is  approprlata  when 
the  action  of  che  subsystem  (x^A^)  on  (*2.A22)  1* 

weaker  than  the  reverse  action.  An  example  of  such 
systems  are  the  power  systems  considered  in  [6].  An 
analogous  problem  formulation  with 


Proof;  Note  first  that  L  is  Invariant  to  the  bels  of 
«,  that  is  there  always  exists  a  nonsingular  matrix  K 
such  that  if  K-VK,  then 


In  particular  lac  che  columns  of  »• 


(12) 


be  che  eigen¬ 


vectors  (and  che  generalized  eigenvectors)  of  A  span¬ 
ning  4, 


and  o(J1)  "Ojj. 


*1 
*2_ 

Now  if  (7)  is  rewritten  as 
R(L)--[L  I)A  QJ 


(13) 


(14) 


sup  o(B^)  <  inf  0(B2)  (6) 

la  also  possible.  Without  the  loss  of  generality  for 
the  rest  of  this  paper  we  assume  (5). 


then  it  simply  follows  from  (13)  and  (14)  chat 
Rf-MjM*1)  -Rf-V^*1)  -0. 

To  prove  (10)  we  use  (13)  in  che  expanded  form 


(13) 


If  an  admissible  n^  is  known,  then  it  was  shown 

in  (2,8,10)  that  a  numerically  suitable  transformation 
for  the  time  scale  separation  is 

72**24'Lx1  <7) 

idiere  L  satisfies 
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M2l(All+A12M2M*l)Ml-J1  (16) 

which,  due  to  (11)  and  (13),  proves  that  B^-A^-A^L 
has  as  its  spectrum  Che  dominant  spectrum  dQ. 

Discussion;  The  three  important  facts  about  this  leasa 
should  be  noclced.  First,  that  L  can  be  expressed  in 
a  basis  free  fora.  Second,  chat  n^  Is  admissible  end 

third,  chat  it  nonsingular. 
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The  freedom  in  expressing  L  1*  an  advantaga  tx- 
pior*d  nor*  in  eh*  n*xc  secclon.  Th«  n«*d  to  specify 
nt  1*  a  disadvantage  sine*  an  arbitrary  n^  nay  not  ba 

adaissibla  and/or  nay  b«  singular.  Therefor*  it  is 

desirable  that  an  iterative  algoritha  has  the  capabil¬ 
ity  to  detect  if  is  noc  admissible  and  to  redefine 

it. 


For  an  admissible  n^,  as  shown  in  (4] ,  there 

always  exists  an  ordering  of  variables  within  a  stace 
vector  x  for  which  1*  nonsingular.  It  is  desirable 

to  find  this  ordering  before  the  block  triangulariza- 
tion  is  attempted.  For  this  purpose  it  is  useful  to 
note  [11]  that  the  existence  of  L,  chat  is  the  non- 
singularity  of  is  related  to  the  controllability 

and  observability  properties  of  the  pairs  (Aj^.Ajj) 
and  (A22'A12^*  If  Bi  l*  viewed  a*  a  regulator  system 

macrix  with  L  as  a  feedback  assigning  ch*  domlnanc 
spectrum,  then  for  Co  be  nonsingular  all  the  eigen¬ 
values  of  A ^  uncontrollable  through  A^  oust  ba  in 

Che  domlnanc  spectrum.  Since  ch*  same  L  la  an  observ¬ 
er  macrix  assigning  ch*  nondominanc  spectrum  to  Bj, 

all  the  eigenvalues  of  A22  unobservable  through  A^2 
must  be  in  the  nondominanc  spectrum. 

These  conditions  ara  likely  to  be  mat  if  an 
ordering  of  states  is  such  chat  the  norm  of  1*  the 

smallest  possible  meaning  chat  x^  should  contain  slow 
variables  only.  Such  an  ordering  usually  results  in 
ch*  reduction  of  ch*  norm  of  either  A^j  or  Aj^  and 
hence  ^(A^)  becomes  close  to  a(B^)  and  o(Ajj)  close 
to  o(B2).  For  the  class  of  systems  Implied  by  the 

formulation  (S)  this  further  means  chat  the  solution  1 
of  (8)  will  have  small  norm. 

The  following  example  illustrates  some  of  these 
observations.  The  system 

1  0  1  o' 

0  2  0  0 

x  • 

0  0  3  0 

0  0  0  4 

is  already  in  a  block  triangular  form  but  with  a(B^)  F 
jd.  For  this  system  Cher*  is  no  L  of  (6)  which 

achieves  time  scale  separation  (4)  and  (S) .  The  rea¬ 
sons  are  the  misplaced  eigenvalues  A* 4,  which  is 
unobservable,  and  \a2,  which  is  uncontrollable.  It 
is  obvious  that  the  same  system  with  reordered  states 

x •  (x^.x^.Xj ,Xj)*  hat  Vj  of  (11)  nonsingular  and  L*0 

satisfies  (7).  Although  V«Z  is  still  unobservable 
end  A  "4  is  uncontrollable,  they  both  belong  to  the 
appropriate  spectrum  and  do  not  have  to  be  moved. 

THE  SUBSPACE  METHOD 

The  well  documented  globally  convergent  simul¬ 
taneous  iteration  method  for  computing  a  basis  of  ch* 
dominant  elgenspac*  [l]  is  now  applied  to  solve  for  L 
in  (11).  It  consists  of  *  simple  iterative  scheme 

Vk+l  •  AVk.  (18) 


x,  Oj^Z  (17) 


>  •  nxn, 

initial  guest  almost  any  full  rank  matrix  V°  fcR 
can  be  used.  The  only  restriction  considered  a*  mild 
[1],  is  chat  no  column  of  V®  is  orthogonal  to  any  of 
the  lefc  eigenvectors  of  A  corresponding  to  Op.  A 
matrix  V®  generated  by  ch*  random  number  generator  will 
almost  always  be  admissible.  However  such  a  macrix  may 
need  many  iterations  (IS)  before  ic  makes  a  basis  for 
a.  It  was  found  experimentally  chat  with  ch*  ordering 
of  states  according  Co  ch*  preceding  discussion  a 
better  initial  condition  is  given  by 


V 


0 


(19) 


For  numerical  reason*  at  each  iteration  columns  of 
V  are  scaled  to  have  unit  norma.  Occasionally,  an 
orthonormalizaclon  of  V  is  also  performed  in  order  to 
retain  a  good  basis  for  an  n^ -dimens tonal  subtpac*. 

Further  discussion  of  ch*  numerical  aspects  of  (18)  is 
contained  in  [1]. 


It  haa  been  shown  in  [1]  that  ch*  subspac*  itera¬ 
tions  have  linear  rat*  of  convergence  with  the  slowest 

v 

converging  column  of  V  differing  after  k  iterations 

It 

from  ch*  corresponding  vector  in  *  by  0(£  )•  Thus  by 
observing  the  speed  of  convergence  of  the  column*  one 
can  decide  whether  to  reduce  the  Assumed  n^«  After  n^ 

is  reduced  the  iteration  process  continues  with  the 
k 

remaining  columns  in  V  . 


The  convergence  behavior  of  (18)  is  best  monitored 
through  the  error  matrix 

E  •  AQ  -  QT.  (20) 

The  matrix  Q  in  (20)  is 

Q  .  Vk  .  u  (21) 

lr 

where  V  is  an  orthonormal  matrix  from  (18)  and  U  is 
an  orthonormal  matrix  transforming  n. -dimans Iona 1 

k  T  k  1  * 

matrix  (V  )  AV  to  a  quasi-uppar- triangular  T, 

UT((Vk)TAVk)U -T.  (22) 

k 

Not*  that  et  V  approaches  e  basis  for  a,  Q  approechts 
the  Schrcr  vector  basis  [1]  for  Ch*  same  epee*  and  r^ 

tends  to  rsro.  Furthermore  if  in  each  step  diagonal 
blocks  of  T  art  ordered  in  descending  order  of  eigen¬ 
value  magnitudes,  then  the  first  columns  in  q  tend 
fatter  to  the  basis  vectors  and  correspondingly  the 
flrsc  columns  in  E^  tend  fascer  to  rero. 

The  compucedonal  load  of  ch*  convergence  monitor¬ 
ing  is  contained  in  compudng  ch*  unitary  transforma¬ 
tion  of  the  low  order  matrix  of  (22).  Alternatively, 
when  it  is  known  beforehand  that  n^  is  admissible  a 

convergence  teet  using  iiR(L)il  computed  from  (8)  can  be 
used. 


Due  to  linear  convergence  of  (18),  predicted  by 
[1],  ch*  Cwo  consecutive  tests  of  column  norm*  in  E 
can  be  used  for  several  purpose*. 


* 

Diagonal  elements  of  T  art  2x2  blocks  concaining 
complex  eigenvalues  and  lxl  blocks  containing  real 
eigenvalues  of  (Vk)TAVk. 


Through  lctraclons  (18)  iniclally  glvsn  column  vectors 
of  V  rotate  uncil  they  font  *  beet*  of  •.  As  *n 


First,  Co  predict  che  number  of  Iterations  before  each 
of  che  columns  in  Q  fells  below  Che  specified  toler¬ 
ance.  Second,  Co  reduce  n,  If  che  slow  convergence  Is 

predicted  for  some  columns.  Third,  Co  remove  from  V 
che  columns  chec  satisfy  (22).  They  are  reconsidered 
again  only  during  che  orthonormalizatioo. 

Example:  In  che  following  7-ch  order  power  system 
example  [6],  we  Illustrate  che  speed  of  convergence  of 
che  subspece  iterations  by  showing  norm  of  columns  in 
E  as  a  function  of  iterations  and  eigenvalue  separa¬ 
tion  S.  In  (18)  we  use  a"*  lascead  of  A  end  hence 
problem  formulacion  (6) .  From  Figures  lb  and  Ic  it  is 
clear  Chat  smaller  C  results  in  faster  convergence. 
Figure  Ld  shows  chat  for  £  *  l  there  is  no  convergence 
for  some  columns.  The  convergence  behavior  of  Figure 
Id  would  suggest  co  reduce  from  4  to  3.  Eigenvalues 

of  A  are  given  in  figure  la. 

Uich  V  obtained  from  (18)  che  crans  forma  don 


n^  «  3,  e«  0.4? 
(c) 


*2  -  vis. 


(23) 


due  Co  Lemma  l,  yields  che  cine  scale  separation  (4), 
(3).  In  order  Co  have  a  well  conditioned  V ^  before 
che  inversion  an  ordering  of  states  (equivalent  Co  row 
permutations  of  V)  can  be  performed  to  make  a  norm  of 
VL  as  large  as  possible.  Then,  as  discussed  earlier, 

resulting  L  will  have  a  small  norm. 

The  subspace  iterations  are  particularly  useful 
for  large  systems  vlch  sparse  A.  An  advantage  of 
sparsity  can  be  taken  while  carrying  out  che  recursion 
(18)  and  while  scoring  A. 


2  4  6  8  10  12 

l-f-H - m - - - l-f — t - th- 


la  Eigenvalue  Magnitudes  of  A 


nj  •  4,  c  •  l 
(d) 

Figures  b.  c,  d:  Convergence  behavior  of  the 
•ubiflic*  iteration*. 


Oj  •  2,  c*  0.17 

(b) 


RELATION  BETWEEN  THE  SUBSPACS  AMD 
THE  RICCATI  ITERATIONS 

We  now  establish  a  relation  becween  che  subspace 
iterations  (IS)  and  che  Riccacl  iterations 

ht+i  *  He -R<V  ^11-^2  v'1 

where  R(L^)  l*  defined  by  (8).  If  the  iteration  (24) 

converge  we  will  show  that  they  yield  the  spectrum 
separation  (5).  Similar  itarations  ware  proposed  in 
[2,3]  for  obtaining  the  separation  (6).  they  are 
cLelmed  to  be  locally  convergent.  Here  we  show  that 
(24)  is  globally  convergent.  By  using  a  similar 
approach  the  same  can  be  proved  for  the  algorithms  in 

(2.31. 

Lamps  2 :  providad  all  Indicated  inverses  exist,  che 
sequences  -(VR(Vj)"S  of  che  eubtpece  algorithm  (18) 
and  of  Cha  Riccacl  algorithm  (24)  are  Identical 


(25) 

Sub*cicuciag  *  -  p'w't  into  ch*  partitioned  fora  of 
(18)  one  gees,  after  some  simple  manipulations 

l/x  1  Jr  v 

P  <AirAuV  *A22P  -A21-  <26> 

Usin^  **' *  L^,  where  L^  satisfies  (24),  the  equation 
(26)  is  identically  satisfied  for  every  k . 

This  lesma  shows  that  both  algorithms  have  the 
same  speed  of  convergence.  Their  differences  are  in 
numerical  conditioning,  memory  requirements,  and 
ability  to  redefine  n^ 

CONCLUDING  REMARKS 

We  have  considered  the  application  of  the  sub¬ 
space  method  and  Riccati  iterations  for  the  time  scale 
decomposition.  It  has  been  shown  that  both  algorithms 
have  global  convergency  property.  They  converge 
linearly  with  the  corresponding  error  after  k  itera- 

cions  being  0(e  ),  where  c  is  a  measure  of  spectrum 
separation  (5).  In  light  of  the  established  connec¬ 
tion  between  the  two  algorithms,  che  stringent  re¬ 
quirements  on  the  initial  condition  of  Riccati 
iterations  (required  earlier)  are  replaced  by  che 
mild  restrictions  of  the  subspace  iterations.  Sub- 
space  method  provides  an  opportunity  Co  redefine  n ^ 

when  neceseary  by  observing  che  convergence  rate. 

when  initial  ordering  of  stace  vaccor  variables 
is  such  that  x1  contains  physically  fast  variables  and 

x2  physically  slow  variables  then  an  initial  guess 
for  V°  given  by  (L9)  is  preferable  over  randomly 
generated  one. 

The  subspace  Iterations  are  particularly  useful 
for  che  time  scale  decomposition  of  large  dynamical 
systems  resulting  in  sparse  system  matrices  A.  In 
che  cese  chat  cne  dimension  of  che  slow  subsystem  is 
much  smaller  than  the  dimension  of  che  fast  subsystem, 
a  modification  of  the  subapace  method  is  suggested: 

-  use  A  '  instead  of  A  in  (18) 

-  order  states  so  that  contains  slow 
variables  and  che  fasc  ones. 

These  changes  amount  to  using  problem  formulation  (6) 
instead  of  (5)  and  result  In  less  computer  work. 
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Preservation  of  controllability  in  linear  time-invariant  perturbed 
systemsf 

J.  H.  chow: 

Th*  controllability  of  lysteras  with  weak  connections  is  studied.  A  aeceessry  end 
sufficient  condition  for  s  singularly  perturbed  system  to  be  strongly  controllable  is 
obtained.  The  controllability  invariance  of  the  slow  subsystem  of  a  singularly 
perturbed  system  due  to  a  class  of  feet  feedback  controls  is  shown. 


1.  Introduction 

Systems  with  small  parameters  are  common  in  control  problems.  These 
small  parameters,  with  values  proportional  to  a  small  positive  number  /*, 
represent  weak  connections  or  parasitics  (Desoer  and  Shenaa  1970).  In 
networks,  for  example,  they  are  the  stray  capacitances  and  lead  inductances, 
which  induce  high  and  low  frequency  behaviour.  In  this  paper  the  dependence 
of  the  controllability  on  n  is  discussed  for  regularly  perturbed  systems  (O’Malley 
1974)  where  the  system  matrices  are  bounded  for  ***  0,  and  for  singularly 
perturbed  systems  (O'Malley  1974,  Kokotovic  et  al.  1970)  where  the  system 
orders  are  reduced  as  /x— * 0.  It  is  shown  that  these  systems  may  lose  their 
controllability  without  weak  connections  and  the  loss  of  controllability  is 
investigated  by  using  Jordan  forms.  A  necessary  and  sufficient  condition  for 
a  singularly  perturbed  system  to  be  ‘  strongly  controllable  ’  is  obtained. 
Furthermore,  the  controllability  of  the  slow  subsystem  of  a  singularly  perturbed 
system  is  shown  to  be  invariant  to  a  class  of  fast  feedback  controls,  and  hence 
we  can  neglect  the  fast  subsystem  if  it  is  stable.  These  results  clarify  those 
obtained  by  Kokotovic  and  Haddad  (1975),  Kokotovic  and  Yackel  (1972)  and 
Chow  and  Kokotovic  (1970  b).  The  presentation  in  this  paper  is  aimed  at 
giving  a  structural  interpretation  of  the  controllability  (Lin  1974)  of  perturbed 
systems. 

2.  Weakly  and  strongly  controllable  systems 

Consider  a  linear  time-invariant  perturbed  system 

x*A(n)x+B{fi)u  (1) 

where  the  state  x  is  an  n-vector,  the  control  u  an  m-vector,  n  a  small  positive 
parameter  and  A(n),  B(n)  are  matrix  polynomials  in  n  which  are  bounded  at 
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pmd.  System  (1)  is  regularly  perturbed  (O'Malley  1974)  and  letting 
that  is.  eliminating  the  weak  connections,  it  becomes  the  unperturbed  system 

i-Ai  +  Bu  (2) 


where  .4»<4(0),  B«B(0). 

It  is  known  (Lee  and  Markus  1967)  that  the  set  of  all  controllable  pairs 
(.4,  B)  of  system  (2)  is  open  and  dense,  that  is.  if  the  pair  (.4.  B)  is  controllable, 
then  there  exists  a  positive  n*  such  that  the  pair  [A(ni,  Bin))  is  controllable 
for  all  /a€[0,  h*).  Here  we  show  that  controllability  of  the  perturbed  system 

(1)  for  n>0  does  not  guarantee  the  controllability  of  the  unperturbed  system 

(2) .  A  counter  example  is  the  system 
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which  is  controllable  for  ^€(0,  2),  but  is  uncontrollable  at  /i  — 0. 

Using  a  Jordan  form  transformation  f  «£(/a)x  with  S<n)  nonsingular  and 
bounded  for  fi  small  and  non-negative,  the  perturbed  system  (1)  becomes 


i  »  S(n)A(n)S~l(fi)£  +  S(/*)3(/i)u 


V i(/*)  o 

’Gl0*r 

j  i(m) 

Gt(p) 

0  A(m). 

where  Jt(f i),  i»l,  2,  are  Jordan  blocks.  Note  that  the  unperturbed 

system  of  (4)  is  also  the  Jordan  form  of  the  unperturbed  system  (2)  because 
S(ji)  is  continuous  with  respect  to  /a.  Eliminating  the  weak  connections  in 
(4),  the  01m)  elements  in  the  matrices  <?((/x)  will  become  zero,  and  if  the  eigen¬ 
values  of  the  Jordan  blocks  Jp{n)  and  J7(^)  differ  only  by  O(^),  Jp( 0)  and 
Jq{ 0)  will  have  the  same  eigenvalue.  If  the  last  rows  of  the  matrices  6?,(0) 
corresponding  to  JJ0)  having  the  same  eigenvalue  are  linearly  dependent, 
then  the  unperturbed  system  of  (4)  is  not  controllable  (Chen  1970).  For 
example  in  system  (3),  we  have  Gx(§)  »[0]  and  hence  the  state  xx  is 
uncontrollable.  Furthermore,  /,( 0),  i  -  2,  3.  4  have  the  same  eigenvalue  and 
since  <?((0),  i-2,  3.  4.  are  linearly  dependent,  the  controllable  subspace  of  the 
states  x},  Xj,  xt  is  only  the  subspace  xt  »x,»x4. 

We  define  the  perturbed  system  (1)  to  be  '  weakiy  controllable  ’  if  it  loses  J 

its  controllability  when  the  weak  connections  or  parasitics  are  removed.  In 
the  terminology  of  Lin  (1974),  the  unperturbed  system  (2)  of  a  weakly  con-  ^ 

trollable  system  (1)  can  be  structurally  controllable  as  it  regains  its  con-  1 

trollabilitv  bv  a  slight  perturbation.  On  the  other  hand,  we  define  sv3tem  (1) 

1 

I 
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to  be  '  strongly  controllable  '  if  its  controllability  is  maintained  at  n  m  o. 
From  this  definition  and  that  of  Lee  and  Markus  (1967),  we  conclude  that  the 
perturbed  system  (1)  is  strongly  controllable  if  and  only  if  the  unperturbed 
system  (2)  is  controllable. 

A  property  of  weakly  controllable  systems  (1)  is  that  controls  with  gains 
of  the  order  of  1  or  higher  are  required  for  the  placement  of  the  weakly  con¬ 
trollable  eigenvalues.  For  example,  placing  the  pole  -5  of  system  (3)  at 
-6,  the  control  it*  -(1  jn)x1  is  required,  while  placing  the  poles  —  l,  —  1  -/*, 
- 1  -  2/t  at  -  2,  -  3,  -  4,  the  control 


3  (6  —lift  +  (3- lift*  1 2,t* -V) 

Urn - -Xt-t - S  . "  xi  -  ———————  X4 

M  M  #** 


(5) 


is  required  (Mayne  and  Murdoch  1970).  It  is  of  practical  importance  that  these 
undesirable  situations  involving  large  gains  can  be  revealed  by  investigating 
the  unperturbed  system  (2). 
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3.  Singularly  perturbed  systems 

In  this  section  the  controllability  of  a  singularly  perturbed  system  as  0 
is  discussed  with  respect  to  its  slow  and  fast  subsystems  (Chow  and  Kokotovic 
1976  b)  because  its  system  matrix  is  unbounded  at  ,4*0.  A  necessary  and 
sufficient  condition  for  a  singularly  perturbed  system  to  be  strongly  controllable 
is  obtained. 

A  linear  time-invariant  singularly  perturbed  system  is  modelled  as 

ymAu(n)y+Alt(n)z  +  Blln)  u  (6  a) 

»Atl(n)y4-An{fi.)i  +  £i(p)u  (6  b) 

where  the  states  y,  z  are  »lt  nt  vectors,  the  control  u  an  m-vector  and  n  a  small 
positive  parameter.  A^lfj.),  B((p),  >*1,2,  j  *  1,  2,  are  matrix  polynomials 
in  ja  where  A<;(0),  B<( 0),  which  are  denoted  by  Aijt  Bu  are  bounded  and 
is  non-singular. 

We  first  define  the  slow  and  fast  subsystems  of  the  singularly  perturbed 
system  (8).  It  is  known  (Kokotovic  and  Haddad  1973)  that  system  (6) 
possesses  slow  modes  with  small  eigenvalues  of  magnitude  0(1)  and  fast 
modes  with  »,  large  eigenvalues  of  magnitude  0(1/ >).  Assuming  that  the 
transient  of  the  fast  modes  is  instantaneous,  that  is,  letting  ,4*0,  we  obtain 
from  (8)  the  reduced  order  system 

y.-^uy.+ (?*) 

0"  A,iyt  + Ajsz, +  BjU,  (7  6) 

where  the  subscript  s  denotes  the  slow  modes,  z,  can  be  solved  from  (7  6) 

18) 

(9a) 
(9  6) 


and  its  substitution  into  (7  a)  yields  the  slow  subsystem 

i  -  AoJ  +  B0u, 

where  j  ■  y„  u,  is  a  control  of  slow  variables  only  and 

.40  *  Au  —  AuA.,_l.4n 
B0  *  —  AllA1J~lBj. 
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On  the  other  hand,  assuming  that  the  slow  modes  are  constant  during  the 
fast  transient  period  and  the  perturbations  in  Att(n)  and  Bt{p)  are  small,  the 
fast  subsystem  is  obtained  from  (7  6)  as 

pfmAtxf+B  jitf  (10) 

where  /  is  the  fast  part  in  z  and  u{  is  a  control  of  fast  variables  only.  For 
i*A0,  the  fast  sysbsystem  (10)  is  controllable  if  and  only  if  the  pair  (A,,,  Bt)  is 
controllable. 

Since  the  eigenvalues  of  and  Attln  are  far  apart  for  p  sufficiently  small, 
the  following  lemma  holds. 

Lemma  1 

UAu  is  non-singular  and  if  the  subsystems  (8),  (10)  are  controllable,  then 
there  exists  a  /z*>0  such  that  the  singularly  perturbed  system  (6)  is  con¬ 
trollable  for  all  ^.6(0,  ji*]. 

Lemma  1  is  known  from  the  work  of  Kokotovic  and  Haddad  (1975).  Here 
we  show  that  the  controllability  of  the  singularly  perturbed  system  (6)  for  /x  >  0 
does  not  necessarily  require  the  controllability  of  the  subsystems  (8),  (10). 
To  illustrate  this  possibility,  consider  the  system 


(shown  in  Fig.  1)  which  is  controllable  for  pe{ 0,  1).  For  p>0,  the  state  z  is 
not  equal  to  the  control  u  but  is  tracking  it  with  a  small  time  delay,  and  hence 
the  state  y  is  controllable.  But  letting  /*— 0,  the  control  for  the  state  y  is 
eliminated  and  the  slow  subsystem  s»  -s  is  uncontrollable.  Note  that  the 
fast  subsystem  is  controllable  because  there  is  a  strong  dynamic  connection 
between  the  control  w  and  the  state  z.  This  strong  dynamic  connection  is 
different  from  the  weak  static  connection  in  the  perturbed  system  (1). 


Figure  1.  Block  diagram  of  system  (11). 


Another  example  is  the  control  of  the  fast  subsystem  through  the  slow 
subsystem.  The  system 


(shown  in  Fie.  2)  is  controllable  for  n>  0  but  its  fast  subsystem  -/is 
uncontrollable.  In  the  complete  system  (12),  the  connection  between  the 
control  u  and  the  state  y  is  a  strong  connection  by  itself,  but  it  acts  as  a  slow 
filter  such  that  the  fast  transient  in  the  state  :  is  weakly  affected  by  the 
control  u. 
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Figaro  2.  Block  diagram  of  system  (12). 


Similar  to  the  perturbed  system  (1),  weak  connections  may  also  cause  a 
singularly  perturbed  system  (6)  to  lose  its  controllability  as  p~*0.  The  system 
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(13) 


is  controllable  for  i*e(0,  1).  However,  the  state  z,  is  connected  to  it  through 
a  gain  of  —  1/^t  —  1  and  the  gain  —  1  is  a  weak  connection  because  it  is  small 
compared  to  the  gain  —  l//x  for  n  close  to  zero.  Hence  the  fast  subsystem 
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is  not  controllable. 

Although  the  strong  dynamic  connections  in  systems  (11)  and  (12)  are  not 
weak  connections  by  themselves,  they  create  weak  connections  when  combined 
with  other  parts  of  the  systems,  whioh  can  be  revealed  by  a  proper  transforma¬ 
tion  of  the  singularly  perturbed  system  (6).  Since  Att  is  non-singular,  there 
exists  a  transformation 


(15) 


with  T(ijl)  bounded  and  non-singular  for  n  small,  such  that  system  (6)  becomes 
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where  Jt (m)  ar®  composed  of  Jordan  blocks  and  J,(0),  Jt( 0),  G,(0),  Gt( 0) 

are  bounded  (Kokotovic  and  Haddad  1975).  Note  that  system  ( 16)  is  not  the 
Jordan  form  of  the  singularly  perturbed  system  (6)  except  for  /*»1.  Since 
;[  2T(#i)|j  -0(1),  the  pairs  (J,(0),  ff,( 0)),  (Jt(0),  5t( 0))  can  be  obtained  through 
transformations  of  the  pairs  2?0),  (.4IS,  B}),  respectively.  Thu3  if  the  pairs 
(?,(/*)),  (J{(m)>  £{(m))  maintain  their  controllability  without  weak 
connections,  then  the  subsystems  (3),  (10)  are  controllable.  Hence  the  study 
of  the  controllability  of  a  singularly  perturbed  system  for  >0  reduces  to  the 
study  of  weak  connections  in  the  pairs  (J,(m).  Gt(n))  and  («/f(^),  Gt(fj.)). 
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Consider  the  systems  { 1 1)— { 13)  in  the  form  of  (16).  For  system  (11), 
G%(im)  »[>i/(l  -fi)]  and  hence  its  slow  subsystem  is  uncontrollable  as  0.(0) -CO]. 
For  system  (12),  (7t0*)*[-/x/(l-p)]  and  hence  its  fast  subsystem  is  un¬ 
controllable  as  Gf(0)-[0].  Since  the  eigenvalues  are  the  same  in 


</{(/*)■ 


0 

-1-M. 


(17) 


at  n»0,  the  controllable  subspace  of  the  single-input  fast  subsystem  of  (13) 
is  only  the  subspace  /t  «■  /,. 

Similar  to  a  perturbed  system  (1),  we  define  the  singularly  perturbed  system 
(6)  to  be  weakly  controllable  if  it  loses  its  controllability  as  ,u— *0,  and  strongly 
controllable  if  it  maintains  its  controllability  as  n—0.  Combining  this  defini¬ 
tion  and  Lemma  1,  the  following  theorem  is  immediate. 


Theorem  1 

The  singularly  perturbed  system  (6)  is  strongly  controllable  if  and  only  if 
its  subsystems  (8),  (10)  are  controllable. 

Note  that  the  placement  of  weakly  controllable  eigenvalues  in  singularly 
perturbed  systems  (6)  requires  controls  with  gains  of  the  order  of  1  jp  or  higher. 
For  example,  placing  the  pole  - 1  of  system  (11)  at  -2,  the  control 

««(1-1  lp)y-z  (18) 

is  required.  Hence  our  definitions  of  weak  controllability  for  the  perturbed 
system  (1)  and  the  singularly  perturbed  system  (6)  are  consistent  in  this  sense. 

The  above  discussion  of  weak  and  strong  controllability  of  singularly 
perturbed  systems  (6)  complete  the  results  presented  by  Kokotovic  and 
Haddad  (1973).  It  is  important  to  note  that  the  separation  of  designs  proposed 
by  Chow  and  Kokotovic  ( 1 97 6  a,  1 97 6  b )  for  the  approximate  designs  of  singularly 
perturbed  systems  (6)  is  applicable  only  when  they  are  strongly  controllable. 
In  addition  to  saving  numerical  computation,  this  method  avoids  dealing  with 
the  ill-conditioned  system  matrices  of  (6).  For  weakly  controllable  singularly 
perturbed  systems,  exact  designs  are  possible,  but  their  computations  are 
often  numerically  unstable.  Hence  in  practice,  these  systems  are  undesirable. 


4.  Invariance  of  slow  subsystem  controllability 

Examining  the  singularly  perturbed  system  (6)  and'its  slow  and  fast  sub¬ 
systems  (8),  (10),  we  observe  that  to  change  the  dynamics  of  the  subsystem 
( 10),  we  need  the  fast  feedback  control 

U  mV+Fz  (19) 

where  !|F|j»0(l)  and  (Ata-BaF)  is  non -singular.  System  (6)  controlled  by 
(19)  becomes 


y -  Au(n)y  +  Olls(f*)  Bx(p)F]z  +  Bx(n )v  (20  a) 

-  An(n)y  +  [*4.s(/*)  +  Ba(n)F]z  +■  Ba( y.)v  (20  b) 
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and  its  slow  and  fast  subsystems  are 

i«.da*«  +  V*s  (21) 

rf-(An+BtF)f+Btvt  (22) 

respectively,  where 

A0*  -  ■ -In  -  F)(An  +  BtF)~lAtl  (23  a ) 

B0*  -  B,  -  (Au  +■  5l/)(*4«  +  BtF)-lBt.  (23  6) 

Since  the  state  :  contains  a  slow  part  as  well  as  a  fast  part,  the  fast  control 
(19)  also  changes  the  slow  subsystem  from  (8)  to  (21)  whose  dynamics  is  very 
much  different  from  that  of  (8).  However,  the  controlabillity  of  the  slow 
subsystem  of  (6)  is  preserved  with  the  fast  control  (19). 

Theorem  2 

If  .4.,  and  (Att->- BtF)  are  non-singular,  then  system  (21)  is  controllable 
if  and  only  if  system  (8)  is  controllable.  Furthermore,  if  ;ji"j  *0(1),  the  slow 
subsystem  controllability  of  the  singularly  perturbed  system  (8)  is  invariant 
to  the  class  of  fast  controls  (19). 

Proof 

For  system  (8)  we  construct  a  non-singular  transformation  M  of  the  control 
u%,  such  that  the  new  control  is  u?  -  and  then  introduce  a  partial  feedback 

u)«t,+.Vi,  such  that  system  (8)  becomes 

i  -  (-4a  +■  B0MN)s  +  B0Jdv,.  (24) 

Let  M  ml  -  F{A„  +  BtF)~lBt  such  that  J/~l»/  +  FA^B^.  Then  using  the 
identity 

An-'[I  -  B.F(An  +  BtF)~']  -  (Att  +  BtF)-'  (25) 

we  obtain 

BJI  m(3t-  AltA.t-lBt)(I -  F(A.,  +  BtF)-'Bt] 

-  Bx  -  AltAu-'[I  -  BtF{A„  +  S,/)-1]^.-  BtF(An  +  B*F)-lBt 

w.80*.  (26) 

Let  N  »  —  F*4,j-l,4  S1.  Then 
A^B^INmAo  +  B^N 

m  -4 ix  “Mi*  +  +  (<4x,  +  B-lF) 

*  (An  +  B,F)-'BtF .4jt“l.421 
■  -4xx  —  Mu  +  5jF)[/  —  Mjj  +  fijF)~l5JF]*4J1_1'-4M 
-^o*  <27> 

Hence  system  (24)  reduces  to  system  (21).  Since  the  transformation  >v  * 
J/-Lu,  and  the  partial  feedback  control  u>«y,  +  .Vs  do  not  change  the  con¬ 
trollable  subspace  of  system  (8),  the  columns  of  (50,  AaB0,  ...,  A0n'~lBn )  and 

;  ,  40**Jx* . .40*’,‘"l£0*)  span  the  same  subspace,  and  the  first  part  of 

the  theorem  is  proved.  In  addition,  if  jF'!=0(l),  then  system  (21)  is  the 
slow  subsystem  of  the  singularly  perturbed  system  (20),  and  hence  the  con¬ 
trollability  of  the  3low  subsystem  of  (8)  with  feedback  (19)  is  preserved. 
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Theorem  2  shows  that  to  determine  whether  the  slow  subsystem  of  (6)  is 
controllable  or  not,  we  only  hare  to  test  the  controllability  of  the  pair  (A0*.  £<,*) 
for  a  single  value  of  F.  In  addition,  we  can  arbitrarily  place  the  fast  poles 
(Att  +  BtF)ln  without  affecting  the  controllability  of  the  slow  subsystem. 
If  (A.s  +  BtF)  is  stable,  we  can  neglect  the  fast  subsystem  because  we  are 
able  to  control  the  slow  subsystem  for  any  disturbances  of  the  type  (19). 

Theorem  2  also  clarifies  the  issue  that  different  sufficient  conditions  are 
obtained  by  Kokotovic  and  Yackel  (1972)  and  Chow  and  Kokotovic  (1976  b)  for 
the  existence  of  the  near-optimal  solution  to  a  singularly  perturbed  regulator 
which  is  decomposed  into  a  slow  and  a  fast  regulator.  In  the  paper  by 
Kokotovic  and  Yackel  (1972)  the  fast  regulator  problem  is  solved  at  the  first 
stage  and  then  the  slow  regulator  problem  is  solved  at  the  second  stage  which 
requires  the  controllability  of  the  pair  (A#*,  B0*).  In  the  work  of  Chow  and 
Kokotovic  (1976  b),  due  to  the  separation  of  designs,  the  solution  of  the  slow 
regulator  problem  requires  only  the  controllability  of  the  pair  (A0,  B0).  By 
Theorem  2,  these  conditions  are  equivalent. 

5.  Conclusion 

It  is  shown  that  a  perturbed  system  will  lose  its  controllability  without 
weak  connections  if  it  is  weakly  controllable.  Pole  placement  of  such  weakly 
controllable  systems  requires  controls  with  large  gains.  A  necessary  and 
sufficient  condition  for  a  singularly  perturbed  system  to  be  strongly  controllable 
is  the  controllability  of  its  slow  and  fast  subsystems.  In  addition,  the  con¬ 
trollability  of  its  slow  subsystem  is  invariant  to  a  class  of  fast  feedback  controls. 
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abstract:  An  upper  bound  for  the  singular  perturbation  parameter  is  found  for  the 
uniform  asymptotic  stability  of  singularly  perturbed  linear  time  •varying  systems. 

L  Introduction 

System  (1) 

i-A  U(t)x  +  A12(t)2  x(i0)**x0 

nz  »  Aj,(t)x  +  A22(t):  x (to)**  x» 

where  x  and  z  are  n -  and  m -dimensional  vectors  respectively,  h  is  a  small 
positive  scalar  and  r„  is  any  initial  time,  is  referred  to  as  a  singularly  perturbed 
system.  The  “reduced"  system 

^  * (A,,(t)  -  A,j(t)AjI(t)",Aj,(f))x *  A|(t)i  xUo)»x„  (2) 

is  a  singular  perturbation  of  (1)  resulting  from  setting  and  is  here 

assumed  to  be  uniformly  asymptotically  stable. 

We  make  the  following  hypotheses  concerning  (1). 

(Hi  i  The  matrices  A„(t)t,  / «  i.  2  are  bounded  and  have  bounded  first 
derivatives  for  all  t. 

(H2)  The  eigenvalues  of  A22(r)  satisfy  Re(Aj(f))< -y<1>  for  all  f  where  y  is  a 
constant. 

It  has  been  shown  (1).  (2)  that  under  HI  and  H2  where  system  t2)  is 
assumed  uniformly  asymptotically  stable,  system  (I)  is  uniformly  asymptotically 
stable  for  h  sufficiently  small.  Under  these  hypotheses  this  paper  finds  a  bound 
H*  such  that  for  h  s  (0,  ^*),  system  (I)  is  uniformly  asymptotically  stable. 

It  is  well  known  (3)  that  for  h  sufficiently  small,  a  condition  for  the  motion 
i(r)  of  (21  to  be  an  (Hfi)  approximation  of  x(t)  of  (1),  is  the  uniform  asymptotic 
stability  of  the  “fast"  subsystem 

H2mA2l(t)z.  (3) 

"This  work  was  supported  in  part  by  the  US.  Air  Force  under  Cram  AFOSR 
73-2570  and  in  part  by  the  Energy  Research  and  Development  Administration  under 
Contract  U  S.  ERDA  E(49-lXl  2088. 
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Thus  it  is  of  interest  to  be  able  to  determine  the  stability  of  (3).  Clearly  HI  and 
H2  alone  are  not  enough  for  (3)  to  be  stable.  The  existence  of  a  (x0  such  that 
when  HI  and  H2  are  satisfied  and  n  €  (0,  (to),  system  (3)  is  uniformly 
asymptotically  stable  has  been  shown  (4).  From  Theorem  12  of  [(6).  p.  1 17]  a 
bound  for  the  stability  of  (3)  can  be  obtained.  Another  bound  is  found  here  in 
Theorem  I  which  is  less  conservative  for  a  wide  class  of  systems. 

Before  stating  the  main  results  of  this  paper  several  facts  should  be  pre- 
sented.  First,  under  HI, 

|An(t)  — A^j(to)|  s  /3(r  ~  to)  W 

where  j3  is  a  positive  constant  equal  to  the  maximum  of  A:2(t)  for  all  t  by  the 
mean  value  theorem.  Also  for  f  a 10  there  exists  a  K  such  that 

exp|A,a(t0)-~2jjaS/i:exp^--y|^~^  (5) 

when  H2  is  satisfied  (7). 

Let  <t>22(f,  t0)  be  the  state  transition  matrix  of  (3)  and  define  <p(c,  t0) 

«(£.  to)  t0)  -  exp  (6) 

Lemma  1.  Assume  HI  and  H2  are  satisfied  and  (i  *  allf}K  where  0<a  <  y. 
Then  for  **  €  (a,  (i),  <p(t,  t0)  possesses  the  properties 

<p(to.  to)  *  0  (7) 

wu  a*  £55;  “P  (-  •^r})  «> 

where  cr  *  y  -  a  >  0. 

This  lemma  which  is  proved  in  the  next  section  gives  an  estimate  for  the 
error  j(p(t,  t0)|  which  results  from  using  exp  (A22(f„)((i  -  („)/(*))  to  approximate 
d>22  (f.  to)-  Thus  for  n  s  (0,  (i)  system  (3)  is  uniformly  asymptotically  stable. 
That  is,  as  u.  -*  0.  <t>j2(c,  t0)  *“  exp  (A22(t0)((t  -  (0)/(i)l  and  we  may  approximate 
the  solution  of  (3)  by  the  solution  to  the  time-invariant  system 

ui»A22(/o)i  i((0)*2o  (9) 

obtained  from  (3)  by  fixing  A22( f)  at  t0.  Since  Ajjfr,,)  is  a  constant  matrix  we 
can  always  solve  for  exp  (A:2(r0)((r-  („)/(*))  whereas  it  is  often  difficult  to  find  a 
dosed  form  solution  for  0I2(t,  to). 

The  upper  bound  on  a  in  Lemma  1  is  y  and  consequently  we  state  Theorem 
I  which  is  proved  in  the  next  section. 

Theorem  [ 

Assume  HI  and  H2  are  satisfied  and  Mo*y!/£K.  Then  for  jo.  s  (0.  ju.0) 
system  (3)  is  uniformly  asymptotically  stable. 

If  we  set 

y»y/(i.  $m&ln  (10) 


1 


r 
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and 

•Ajj(i)  *  —  Ajj(0  (11) 

A 

we  obtain  the  time-varying  system 

w*AM(t)w  w(t0)»z0  (12) 

from  (3).  From  Theorem  I  for  (3  <  ylIK,  (12)  is  uniformly  asymptotically  stable. 
The  bound  obtained  for  (12)  in  [(6),  p.  117]  is  0  <  y~2!K  In  K.  Thus  for 
systems  where  K  >  e  the  bound  obtained  in  Theorem  I  is  less  conservative.  It  is 
interesting  to  note  the  correspondence  between  small  p.  in  (3)  and  slow-varying 
matrices  A22(t)  in  (12). 

In  the  proof  of  the  next  theorem  we  treat  the  transformed  system 

x  *  A.(t)x  +  A|2({)tj 

(13) 

nv  =  /i(L(r)  +  L(f)A,(t))x  +  A22(i)t)  +  nL(t)Al2(t)-n 
which  is  a  result  of  applying  the  transformation 

Tj*i  +  A22(r)'lA21(t)xAj  +  L(t)  (14) 

to  (1).  Here  A,  is  as  defined  in  (2). 

Theorem  II 

Let  (2)  and  (3)  be  uniformly  asymptotically  stable  systems  so  that  their  state 
transition  matrices  satisfy  (15)  and  (16)  respectively 

l*i U  t0)l«  K,exp(-<r,(r-r0)) 

Vt0,  tar0. 

«o)l  S  K2  exp  |  -  °rz(^2)) 

If  constants  Mlt  M2,  and  M,  exist  such  that  for  all  r 

|Aia(i)|d6M„  |L(t)A,a(t)|asM„  |L(0  +  L(r)A,(l)|*M,.  (17) 

then  for  ail  *x  €  (0.  ;x,),  where  /xt  *  o’,<r2/(<7,K2M2+ K|M,K2Mj),  system  (1)  is 
uniformly  asymptotically  stable. 

The  new  result  in  this  theorem  is  the  explicit  expression  for  f x, .  For  linear 
time-invariant  systems  (5.  6,  10).  Zicn  (10)  obtains  a  bound  for  n  which  when 
integrated  with  (15),  (16),  and  (17),  is  jx,. 

The  next  corollary  follows  immediately  from  Lemma  t  and  Theorem  II. 
Corollary  1.  Let  jx*»min  U 1 ,  ^x,).  If  system  (2)  is  uniformly  asymptotically 
stable,  then  HI  and  H2  guarantee  that  for  *x  s  (0,  jt*),  system  (l)  is  uniformly 
asymptotically  stable. 

In  (1)  and  (2)  the  existence  of  jx*  is  shown  via  Lyapunov  functions. 

The  new  results  of  this  paper  are  the  explicit  bounds  uo.  Mi.  and  jx*  and  the 
expression  bounding  l<p(t,  r,,)|.  Section  II  contains  the  proofs  of  Lemma  l  and 
Theorems  I  and  II.  and  Section  III  gives  an  example. 


(15) 

(16) 


v«.  JO).  .«*».  ivituy  l»7| 
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IL  Proofs 

In  the  proofs  we  will  use  the  following  lemma. 

Gronwail's  Lemma  (6):  Let  Aft)  be  a  real  continuous  function  and  y(t)  a 
non-negative  continuous  function  on  the  interval  [t0,  t,].  If  a  continuous 
function  y(t)  has  the  property  that 

y(f)SA(f)  +  J  y(j)yfs) di  (18) 

for  tastsitu  then  on  the  same  interval 


y(i)sA(0+ 


1' 


A(s)y(s)exp 


Proof  of  Lemma  1: 

The  definition  of  <p(t,  t0)  implies  (20)  and  (21), 

<o)  *  0 


(19) 


(20) 


*(-.  <„) »«,  „p (*m(^)).  (21) 

Applying  the  variation-o(-coastaats  formula  to  (21),  we  obtain 
<p(f>  (o)  *  ^  |  exp  ^Al2(t0)^“-j  j(Aj-(r) 

-  A22(t0))  exp  | A22(t0)|-~))  dr 

^  exp  (Azi(tn)y~ir)) d"  (22) 

We  let  y  *  a  +■  <r,  multiply  (22)  through  by  exp  (cr((r  -  (0)ln))  and  let  n(t.  f0)» 
exp  (<r((/-t0;/M))  v(f.  lo)  to  yield: 

n(t,  t0)  £  exp  «P  (A22(t0;(~))(A32(r) 

“  A22(to))  exp  ^  AJ2(t,j)(— — ^ -j J  dr-~-  j  rj(t,  r)  exp  ^ cr^- — -jj 

*(A:2(r)- A2:(t0))exp  -j)  dr.  (23) 
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We  next  construct  the  successive  approximation 
Vlk*lV  to)  £  exp  (<r(^)  exp  (^:j('o)(^))(A2i(T) 

~  A22(fo))  exp  dr-t™  j  Vk>U  r)  exp  —  j J 


*  (A22(r)  —  Ajj(to))  exp  ^  A22(t0)^  "  j  j  dr  (24) 

with  initial  guess  T7CO)(t,  to)*0.  The  initial  guess  corresponds  to  the  assumption 
that  for  n  small  (3)  has  a  solution  near  to  that  of  the  time-invariant  system  (9). 
Substituting  (4)  and  (5)  into  (24)  and  integrating  for  r\a)[t,  t0 ),  we  obtain 


s2 


«V 


(25) 


for  all  t0,  (2  t<j.  Taking  the  difference  between  two  successive  terms  for  rj,  we 
obtain 


r0)-  T7<k,(r,  t0)  -  £  J['  IVk,(t.  r)-  T,(k-l>(t,  r)| 

*  exp  (^■^^jj(A22(r)-Al2(t0))exp^A„({0)(;^2jjdT.  (26) 


Substituting  in  (4)  and  (5),  yields 

IV‘*°U«o)-VMU<b)l 

S  [  I  V’O,  r)  -  V-l,(t,  r)|  exp  (  -  *(^))  dr. 

Suppose  for  fcSp 


IVk’Ur)-Vk*,,(t.r)|sC<k> 

where  Ck)  are  constants.  Then  by  (27) 

IV^UtoW^UOIs^C"1 

a 

for  all  u  to  and  t  £  (<>•  Since  for  k  *  l 

I  Vk,U  r)-Vk-"(t,r)|s2^. 

a  e 


(27) 

(28) 

(29) 


(30) 


we  have  by  induction 

ih(k*,,(t,fo)-Vk)(t.t0)(s2 


{d*£\k(t 

l  aJ  )  laV  A 


(31) 
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Define  p*p0/C/a2.  Since 

!Vk,0.  'J-  V^’U  f„)|s  l  h«»(i,  f0)| 

i-t 

then  (or  p<l  or  /x < at 2/0K 

lim|Vk>U  to)l*  liinh'k'(t,  t0)  -  T)l0'(r,  t0)|  *  2  ~r  ~ 

k—m  k—  1  —  p  \  a  e  /  e  (a  - 


JJ3 _ 

tfKY 


(32) 


(33) 


Thus  for  p.<a2l0K  the  successive  approximation  (24)  converges  to  a  solution 
which  satisfies 


ho,  gl  a  2  -jA-- 


e2(a2-  p.0K)' 
Now  exp  ar(t-tjp.))  ipfr,  tQ)  *  tj(£,  r0)  and  therefore 


lv(f.y  i*- 


*2K20 


’e2(a2-p.0K) 
This  completes  the  proof  of  Lemma  l. 


exp  -  ol 


T2))- 


(34) 


(35) 


Proof  of  Theorem  I:  Define  p.o  =  y2!0K  and  a  *  jv(mi3AC)  -  y/2  where  ixs 
(0,  Mo)-  Then  cr»y-a>0  and  for  ms(0,  u„)  equation  (35)  implies  that  (3)  is 
uniformly  asymptotically  stable  since  the  definition  of  a  implies  that  <xz-y.K0 
is  never  equal  to  zero. 

Proof  of  Theorem  //:  Applying  the  variation-of-constants  formula  to  (13),  we 
obtain 


x(t)  *<t>i({,  f0)JCo  I  $i(-'.  t)AiZ(t)tj(t)  dr 

Jt* 

lit)  *<J>22(«.  [  <t>22((,  T)Ltr)A,j(r)TtfT)dr  (36) 


+  l' 

+  f  QnU. 


r)(Ur)-*  Ur) A ,(r))x(r)  dr 


where  no*  A  The  bounds  of  Eqs.  (15),  (16).  and  (17)  imply 

!*({)!*  K,  exp  { -  cr,(t-  r0))|x0|  *  [  K,  ex,>  ( -  cr,(t  -  r))M ,  ’n(r)|  dr  (37) 

Jin 


Jemma i  of  TS«  Frankim  tAttuuie 


Uniform  Asymptotic  Stability 


lnU)|s  K2exp  kol  +  j  K,exp  !h(f)idf 

+  j  K,  exp  ^-<rj^~jjMj|x(r)|dr.  (38) 


In  this  proof  we  apply  Gronwall’s  Lemma  to  (37)  and  then  to  (36)  to  derive  the 
upper  bound  such  that  for  n  €  (0,  p.t),  |x(t)|  and  |ri(f)j  are  bounded  by  a 
decreasing  exponential.  Letting  w(t)-exp  ( <r2t/(j. )  |r}(t)|  in  Eq.  (38),  yields 


w(r)  s  K,  exp  (<r,t0/^)  |rj0|  +  j"  K2  exp  (<rirtp.)Mi  |x(x)|  dr  +■  f  K2M2w(t)  dr. 

Jl o 

(39) 

Applying  Gronwail's  Lemma  and  integrating,  we  obtain 
w(r)  s  Kj  exp  (tr,/0/M)  |rj0|  exp  (K2M,(i- 1„)) 


i 


+  exp  (/CjM2(f-r))fC2  exp  (<rjr/>)iVf,  |x(r)|  dr  (40) 


which  yields 

|t)(0|s  /C2  exp  ( -  crj(t- 10))  |t}0|  +  j"  fC2M,exp  (-crj(f-r))  |x(r)!  dr  (41) 


where  o-3  *  cr2/n  -  K2M2.  In  the  following  we  will  need  or3>0. 
Substituting  (41)  into  (37),  yields 


|*(f)|sK,  exp  (-<r,(f-  t0»  i*n! 

+  [  /C,  exp  ( -  <r,(f  -  r))M,  fC2  |rj0|  exp  ( -  or3(r  - 1,,))  dr 
Jto 

J-|  K,  exp  (-<r,(<“r))M,  ^  K2M3  exp  ( -  cr}(i  -  s))  |x(s  >|  dsj  dr  (42) 
which  implies 


!  i 


t'  I  K  |  .Vf , /Cj  |T)y!  .  ,,  M,  Kv  T)ol 

|x(/)|s  \xq\ - -exp  (-a,(r-r„))r - 

<T-y~  <T\  <Ty~  <T  | 


See  corrections 
on  the  next  page 


,  ,  v  fC,.V/,fC„Vf3  f 

x  exp  ( —  cr,(t  —  r0))  \  exp  ( —  cr3(f  —  r»  |xtr)l  dr.  (43) 

Jr. 
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Let  y(f)  *  exp  <r3t  |x(t)|,  apply  Gronwall's  Lemma  and  integrate  to  obtain 

|,(,)l  *  [J$r  ( 1  ~  TkicTm)  1  -  -«l) 


where 


cr  =  o-j-o- 1  — 


KtM,K,M3 


(45) 


Thus  for  (13)  to  be  uniformly  asymptotically  stable,  we  need  inequalities  (46) 
and  t47)  t0  be  satisfied,  i.e. 

OS 


M 

o’]  —  . . . .  >  0. 

<T\ 


(46) 

(47) 


Let 


Mt 


O‘|0'2 


<riKIM2  +  K,MlK2M  j 


If  4  e  (0,4,)  inequalities  (46)  and  (47)  are  satisfied  and  therefore  (13)  is 
uniformly  asymptotically  stable  which  implies  that  (l)  is  uniformly  asymptoti¬ 
cally  stable. 

III.  Example 

The  system 


x 

Mi, 

UMijJ 

has  the  reduced  system 


r-4-rcos  t 
l 
0 


1 

-1  +  1.1  cos2  r 


and  fast  subsystem 
Mb  * 


-1  +  1.1  cos2  / 


0 

■  X" 

l  -  1.1  sin  t  cos  t 

(48) 

-  1  +  l.l  sin2 1  . 

-*2- 

sin2  t)i 

(49) 

1 . 1  sin  t  cos  t"| 

1  +  1.1  sin2 1  I71' 

(50) 

When  4  *  l  an  unstable  fundamental  solution  of  (50)  is 

!"  e°  “  cos  :  e“  sin  t 
<*>:('•  0)»  01,  . 

-  e  sin  t  e  cos  t 


(51) 
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CORRECTIONS  OF  EXPRESSIONS  (42)  through  (47) 


In  (42)  variable  t  was  mistakenly  taken  as  t.  Instead,  (42)  should 


read 


|x(t)|  <  Kj_e 


-o1(t-to)  t  -a, (t-t) 


—  w  \  w  W  "^,(T“t  ) 

*0I  +  /  Kie  Mi^Mole  dt 

Co 


t  -C-.,(t-T)  t  -O.(t-s) 

|x(s)|ds)dx. 


+ /  Kxe  1  M x(f  K2M3e 


Replace  (43) -(47)  by 


K.M.K,|n  i  -o.(t-t  )  KMK  |n  |  -o  -(t-t  ) 
x(t)|  i(li,|,|-  0-1-2 ..°-le  1  o  „  3  ° 

1  1  1'  o'  a3-al  °3~g1 


-at  t  (a.-a,)T  t  crs 

+  ILK  M  M  e  [/  e  (/  e  |x(s)|ds)ds. 

l  /  l  J  t  t 

o  o 


(43) 


Integrating  by  parts  (47)  becomes 
|x(t)|  <  Pje 


1  0  +  v  3  - 


x(t) I dx 
(44) 


where 


Pl*Kl!Xoi  0  i 


K1M lK2‘noi 

a3~ai 


P3  "  KlWV 


Take  (condition  I)  (44)  can  be  written  as 

-a  (t-t  )  -a  (t-t  )  P,  t  -a  (t-x) 

|x(t)|<P  e  1  0  +  P2e  3  0  +  l  e  1  |x(x)|dT.  (45) 

^  ^  Co 


a,t 


I 

Let  y(t)“e  |x(t)|,  apply  Gronwall's  lemma  and  integrate  to  obtain 


|x(t)  |  <  Pl( 


-a, (t-t  )  -a, (t-t  )  -(a,~?A)(t-t  )  “a, (t-t  ) 

,  1  °  +  ?2e  3  0  +  p^[e  14  0  -  e  1  ° 


-a-(t-t  )  -(a.-P,)(t-t  ) 

*  P2P4t»  3  0  -e  1  4  0  1 


(46) 


where 


Thus  for  (13)  to  be  uniformly  asymptotically  stable  we  need  the  following 
inequalities  to  be  satisfied 


i  i 


a.  >  P.  and  o_  >  a, 
14  3  1 


i.e. 


f  ‘  K2M2  >  °1 


u  < 


al  +  K2M2 


a,  > 


K1K2M1M3 


1 


u  K2M2-*1 


M  < 


a2°l 


ai  +  K2M2°l  +  KlK2MlM3 


From  (46a)  and  (46b) 


°1C2 


1  +  <^1K2M2  +  K1M1K2M3 


(46a) 

(46b) 


(47) 
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even  though  the  eigenvalues  of  A12  (t)  have  real  parts*  -0.45  for  ail  t  [(9),  p. 
147].  Since  system  (48)  satisfies  HI  and  H2  and  system  (4  is  uniformly 
asymptotically  stable,  we  know  that  for  n  sufficiently  small,  both  systems  (49) 
and  (48)  are  uniformly  asymptotically  stable.  In  this  example  we  find  bounds 
Mo  and  fit- 

Fixing  the  coefficients  of  the  “fast”  subsystem  at  any  t  *  obtain  the 
linear  time-invariant  system 


Mi) 


-1  +  1.1  cos2 10  l  +  1.1  sin  t0cos  t„ 
-  1- 1.1  sin  tocos  to  -l  +  l.lsin2t0 


The  state  transition  matrix  for  (52)  is 


(52) 


exp  Ai2(t0)T 


au(t„)  cos  0.835t-  5,  ,(f0)) 
atii(to)  stn  0.835t) 


a,2(f„)  sin  0.835 r) 
a22(t0) cos  0.835r-  522(r0)) 


(53) 


where  r  *•  (r  —  r0)//j_ 

au(t0)»  (1 .377  -1.617  sin2  r0  +  1 .734  sin*  t0)K 
«,,(«- (1.198- 1.317  sin  t0c os  t0), 

<*2i(fo)*(“  L.198- 1.317  sin  t0cos  tn). 
a22{t„)  ■  (1.377-  1.617  cos2  r„  + 1 .734  cos*  t0)>, 

Sn(t0)  *  tan"'(0.614-  1.317  sin2 t0), 

S22 (f0)  ■  tan*1  (0.6 14-  1.317  cos2  t0). 

Using  as  a  norm  (J]ar2(t0))*  we  find  that  K  *  7.358  and  y*0.45.  Correspond¬ 
ingly  we  find  the  max  A32(r)  *  1.555  *  /3.  The  values  of  0.  K  and  y  and 
Theorem  I  imply  that  >io»0.0l77  and  that  for  0  <(x</2„  System  (3.3)  is 
uniformly  asymptotically  stable.  The  bound  obtained  using  Theorem  12  of  [(6), 
p.  117]  is  0.0089  which  is  approximately  ]  of  /*<,. 

We  next  find  a  bound  for  the  stability  of  the  full-order  system  (48).  From 
Lemma  1  we  obtain 


\ 

e:(a2-  jifCp)/ 


exp(-<7t/>i). 


(54) 


If  we  let  a  *  cr  *  yl 2  we  obtain  a  value  for  ii  of  0.00442.  For  s  (0.  >i)  we 
may  use  the  bounds  of  (54)  for  $22(t,  t„).  This  saves  the  work  which  would  be 
necessary  to  derive  1. 10).  Thus 


and  0-2  * 


i' 


IC.-K  1+2' 


V(<72-^K/3)/ 


0.225.  From  Eq.  (49) 

|i(t)|s|xo|exp  (-  1.39(t  -  [0)) 


which  yields  K  *  1  and  it,*  1.89. 
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Values  for  M1t  M3,  and  iVf3  are  1,  1.9S6,  and  7.09  respectively.  Substituting 
these  values  into 


11  <r,K1M2  +  K,M,K2MJ 

yields  p.i  ■0.00317.  Since  we  know  from  Corollary  1  that  for  p.  e 

(0,  Hi)  system  (48)  is  uniformly  asymptotically  stable. 

This  example  illustrates  the  use  of  Lemma  l.  Theorems  l  and  II  and 
Corollary  1  in  obtaining  the  stability  bounds  of  p  in  system  (48).  The  bounds 
K2  and  <r2  are  direct  results  of  Lemma  l,  thus  making  it  unnecessary  to 
determine  the  state  transition  matrix  for  the  fast  subsystem  directly. 

IV.  Conclusion 

The  main  results  of  this  paper  are  contained  in  Lemma  l  and  Theorems  I 
and  II.  These  provide  bounds  for  the  stability  of  the  “fast"  subsystem  (3)  and 
the  full-order  system  (1).  These  bounds  are  found  through  consideration  of 
reduced-order  systems  of  order  m  and  n.  Thus  the  uniform  asymptotic  stability 
of  an  n  +  rnth  order  system  can  be  shown  while  considering  only  the  reduced- 
order  system  and  fast  subsystem.  Furthermore,  the  state  transition  matrix  of 
the  “fast"  subsystem  can  be  approximated  by  the  more  easily  determined 
«p(A22(r0)((r-r0)/n))  to  within  <p(t,  f0)  error.  The  bound  on  <p(t.  t0)  found  in 
Theorem  1  is  a  byproduct  of  the  derivation  of  the  bound  pn.  The  fact  that 
<p(c,  r„)  is  0(|x)  and  is  exponentially  decaying  with  an  0{p)  time  constant  is  also 
of  use  in  proofs  of  various  optimality  results  for  time-varying  singularly 
perturbed  systems.  For  instance  it  may  be  used  in  extending  results  already 
proved  for  linear  time-invariant  systems  to  time-varying  systems.  Thus,  this 
paper  unifies  the  work  of  a  number  of  authors  and  adds  bounds  for  p. 
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Stability  of  Singularly  Pertorbad  Systems  and  Networks 
with  Parasitica 

R.  R.  WILDE  and  P.  V.  KOKOTOVIC 

Abttrmci — It  is  noted  that  somo  racont  stability  results  for  aingvler 
perturbation  pro  bisms  art  special  cases  of  earlier  theorems  by 
IClimnshaT  end  Krsaovakii.  A  simplified  proof  of  one  of  these 
theorems  is  given. 

4 

In  [l]-[3]  Deeoer  end  Shews  present  a  stability  analysis  of 
singularly  perturbed  time-invariant  systems  and  apply  it  to  net¬ 
works  with  small  and  large  parasitica.  The  purpose  of  this  corre¬ 
spondence  is  to  point  out  that  Klimushev  and  Kraeovslrii  [4]  en¬ 
compass  the  stability  theorems  in  [1)-[31.  As  an  illustration  of  this 
we  quote  and  prove  a  theorem  for  linear  time-varying  systems, 
which  represents  the  stability  part  of  (4,  theorem  1).  It  is  hoped  that 
the  familiar  style  and  notation  of  the  proof  given  here  will  contribute 
to  better  understanding  of  the  little-known  results  of  [4|. 

The  theorem  that  follows  deals  with  uniform  asymptotic  stability 
of  the  (n  4-  mi-dimensional  system 

t  m  Au(t)x  4-  A  11(f)* 

M*  —  A«(<)*  4-  An(f)s  (1) 

where  p  is  a  small  positive  scalar  and  a  dot  denotes  derivative  with 
respect  to  t.  Stability  properties  of  (1)  for  m  sufficiently  small  are 
deduced  from  stability  properties  of  two  auxiliary  systems:  the  Tri¬ 
dimensional  system 

$  -  An(*)q  (2) 

where  t  >  U  i*  »  fixed  parameter,  and  the  n-dimensional  system 

t  -  IA„«)  -  Au(f)A«-‘(OA«(f)lp.  (3) 

Theorem.-  If 

1)  all  the  matrices  An(t)  in  (1)  and  their  derivatives  are  bounded 
and  continuous  functions  of  f  for  all  f  >  U, 

2)  the  real  part*  of  all  the  eigenvalues  of  Au(«)  are  smaller  than 
a  fixed  negative  number  for  all  t  >  4, 

3)  system  (3)  is  uniformly  asymptotically  stable, 

then  there  exists  a  a*  >  0  such  that  system  (1)  is  uniformly  asymp¬ 
totically  stable  for  all  *  G  (0,  m*J. 

Proof:  Define  4z  and  *y  using 

Xt  -  *1  +  tot 

*1  -  si  +  4y  -  An~lAn*z  (4) 

where  (zu  *1)  and  (it,  *»)  are  solutions  of  (1)  corresponding  to  two 
different  initial  conditions.  (For  brevity,  argument  ( is  dropped  when 
no  confusion  results.)  Upon  substitution  of  (4)  into  (1), 

It  -  Six  4-  Auiy 

»V  -  -  4-  ((.$  4-  SR)»z  4-  SAttlyl  (5) 

M 

where  R  *  Ah  —  AuA«_,An,  S  «  An"lAti.  Clearly,  when  (5)  is 
uniformly  asymptotically  stable,  so  is  (1).  Let  M(t)  be  the  unique 
positive  definite  solution  of 
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4-  MAn(*)  -  f6) 

for  all  *  >  b.  Hen  and  in  (9)  It  denotes  a  k  X  k  identity.  From 
condition  2)  it  follows  that  q'M(l)q  is  a  Lyapunov  function  for  (2). 
Let  the  function  p'N(t)p,  whose  derivative  for. (3)  is  — p'p,  be  a 
Lyapunov  function  guaranteeing  condition  3).  This  function  exists 
by  a  well-known  Lyapunov  theorem,  such  as  [5,  theorem  3]. 

It  is  now  shown  that,  for  a  sufficiently  small  positive  m>  the  function 

w  -  te'N(l)4*  4-  >y'M(t)*V  (7) 

is  a  Lyapunov  function  for  (5 )  satisfying  the  requirements  for  uniform 
asymptotic  stability,  such  as  the  conditions  of  [5,  theorem  1J.  By 
definition  of  M(t)  and  ,V(<)  there  exist  continuous  nondecreasirig 
functions  a  and  0  of  the  norm  ||lz,  Jy  ||  such  that  <*(0)  —  0, 0(0)  —  0, 
and 

0  <  «(||fo,  April)  £  w  <  0(||*e,  ljr||)  (8) 

holds  for  all  t  >  t,  and  all  tx  4  0 ,  Sy  ri  0.  The  derivative  of  no  for 
(S)  is 


p JiTf  — /»  .VAh  4-  (■$  4-  3R)'A/"j  r i*"j 

L*»J  Lina,,  4-  (i  4-  SRYMV  -(1/M)/.  +  L  J  L«wJ 


where  L  -  M  4-  ( SAaYM  +  M(8Au).  After  substitution  of  *  by  t 
in  (6)  and  differentiation  with  respect  to  1,  it  follows  that 

Afir«)  -  J  tA”'w'[AWd)M(t)  4-  Md)Ar,d)]eAM’  do.  (10) 

Hence  L  is  bounded  for  all  t  >  («  and  is  dominated  by  —  (1/m)/» 
when  m  is  sufficiently  small.  Inspection  of  leading  principal  minora  of 
the  symmetric  matrix  in  (9)  shows  that  there  exists  a  positive  m* 
■such  that  for  all  m  €  (0,  M*l,  all  t  >  U  and  all  lx  ri  0,  ly  ri  0 

<  —  v(||fa,  iy||)  <  0  (11) 

where  y  is  a  nondecreasing  function  and  y(0)  -  0.  Properties  (8) 
and  (11)  of  w  and  }Jb  prove  that  (5)  is  a  uniformly  asymptotically 
stable  system  for#*  €  (0,  n*J. 

The  technique  of  this  proof  also  gives  bounds  for  perturbed 
solutions  and  can  be  extended  to  nonlinear  systems  [4].  Some  as¬ 
sumptions  made  here  and  in  [4]  can  be  relaxed.  Stability  theorems  in 
(ll~(3!  proven  by  a  different  technique  are  special  cases  of  the  theo¬ 
rems  in  [4].  The  results  of  [4)  have  remained  unnoticed  not  only  in 
[l]-(3),  but  also  in  the  book  [6]  and  the  survey  (7).  A  more  general 
result  on  asymptotic  stability  of  singularly  perturbed  systems  is 
found  in  [8|. 
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Reduced  order  modelling  and  control  of  two-dme-acale 
discrete  systems! 

R.  G.  PHILLIPSJ 

A  clui  of  linear  «hift-invanant  discrete  lycterae  letisfying  a  two-ttme-ac&le  property 
ie  defined  and  a  model  satisfying  thia  property  ia  given.  A  pair  of  explicitly  invertible 
block  diagonalicing  tranaformationa  are  uaad  to  obtain  reduced  order  faat  and  alow 
modela  analogoua  to  the  continuoua  ungularly  perturbed  caae.  A  deadbeat  approxi¬ 
mation  to  the  faat  modea  reaulta  in  a  reduced  order  alow  model,  and  a  '  boundary 
layer  '  error  in  the  original  faat  atatea.  For  control  law  deaign,  the  dual  nature  of 
theae  block  diagonalixing  tranaformationa  allows  partial  or  total  eigenvalue  placement 
for  faat  and/or  slow  modea  baaed  on  feedback  designs  for  the  reduced  order  stow  and 
fast  modela. 


1.  Introduction 

Methods  for  approximate  control  of  large  scale  systems  have  received  a 
great  deal  of  attention  in  recent  works.  Of  these  methods,  aggregation  and 
singular  perturbations  seem  to  be  the  most  well  known  (Aoki  1978).  The 
analysis  and  control  design  of  continuous  linear  singularly  perturbed  systems 
has  been  well  documented  (Kokotovic  et  ai.  1976,  Chow  and  Kokotovic 
1976  a,  b).  The  multiple-time-scale  property  of  these  systems  has  been  used 
in  deriving  reduced  order  models  and  control  laws  for  high  order  ‘  stiff  ’  models. 
Until  recently,  all  the  work  done  on  systems  possessing  a  muitiple-time-scale 
property  has  been  on  continuous  systems.  The  area  of  discrete  two-time¬ 
scale  systems  has  received  little  attention. 

In  this  paper  a  class  of  discrete  systems  satisfying  a  two  time-3cale  property 
is  introduced.  A  pair  of  block  diagonalizing  transformations  are  then  derived 
based  on  the  properties  of  the  two-time-scale  model.  The  appealing  feature 
of  these  transformations  is  that  they  have  an  explicit  inverse.  This  block 
diagonal  form  is  then  used  to  obtain  reduced  order  models  for  both  simulation 
and  control  design.  A  design  procedure  is  given  which  allows  all  eigenvalues 
of  the  higher  order  model  to  be  placed  at  desired  locations  based  on  control 
laws  designed  for  the  reduced  order  models.  Finally,  an  eighth  order  power 
system  example  is  given. 

2.  Bask  definitions 

Consider  the  completely  state  controllable  linear  shift-invariant  discrete¬ 
time  system 

'*!(*+ 1)1  1"  Au  A12irxl(fc)1  [Rj* 

*  +  u(k)  (1) 

_x2(fc+l)_  _  -"i  52  _  x^k)_  _Rj_ 
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where  xx(k)eRN',  xt(k)eRNt,  u(k)eRM. 

There  will  exist  a  basis  such  that  (1)  takes  the  form 

■*.(*+!)]  o"|  r*.(*) 

„*f(*+  1)J  L°  ^JU<*> 

such  that,  if 

At  A  max  |Aj(A,)| 

A,  A  min  |A,(A,)| 

I 

then 

Af  <  A, 


(2) 


The  system  (2)  is  not  necessarily  in  its  modal  form,  however,  multiple  and  com¬ 
plex  conjugate  eigenvalues  are  naturally  grouped  together  in  either  A,  or  At. 

System  (1)  is  thus  said  to  possess  a  two-time-scale  property  if  there  is 
sufficient  ‘  gap  ’  between  the  eigenvalues  of  A,  and  At.  Noting  that 

min  )  \(  A ,)  |  >  jj  A  || -l  (lower  bound) 

( 

max  |Aj(*4f)|  <  ||^lf(|  (upper  bound) 

The  two-time-scale  property  can  be  expressed  as 

(3) 


3.  System  forms  and  block  diagonal izatkm 

A  class  of  discrete  systems  possessing  a  two-time-scale  property  has  the  form 


■*!(*+!)■ 

as 

'  Au 

p^Aii 

■*i(*)' 

+ 

'Bx' 

xt(k  + 1) 

i*An  _ 

.*,(*). 

where  Au-1  exists,  0  <  j  ^  1 ,  and  p  is  a  small  positive  parameter  and  can  be 
defined  as  ||  Aa||/||  Au||. 

The  permutation  and/or  scaling  of  states  necessary  to  put  two-time-scale 
continuous  systems  into  specific  forms  is  discussed  in  Avramovic  (1979)  and 
Chow  (1975).  Our  purpose  now  is  to  transform  (4)  into  form  (2)  and  show  that 
the  resulting  A,  and  .4,  submatrices  satisfy  the  two-time-scale  property  of  (3). 

It  will  be  convenient  throughout  the  remainder  of  the  paper  to  use  the 
following  notation. 

Atl-p>A,i,  Au=nA„  (5) 

These  substitutions  will  be  made  interchangeably  throughout  the  remainder 
of  the  text,  depending  on  whether  or  not  the  relative  magnitude  of  the  sub¬ 
matrix  norms  is  needed  explicitly. 

For  (4)  to  possess  the  two-time-scale  property  as  has  been  defined,  it  will 
be  necessary  that  the  spectrum  of  (4)  consist  of  N%  ‘  slow  ’  eigenvalues  of  magni¬ 
tude  0( ||  Au||)  disjoint  from  Nt  ‘  fast  ’  eigenvalues  of  0(/u)  magnitude.  Various 
norm  bounds  can  be  derived  to  guarantee  that  (4)  has  this  property  (Feingold 


Reduced  order  modelling  and  control 


and  Varga  1962,  Stewart  1971).  Here,  we  apply  a  lemma  from  Kokotovic 
(1976)  and  extended  results  in  Arvamovic  (1979)  and  Phillips  (1979)  to  achieve 
a  bound  on  p  in  terms  of  the  submatrix  norms  such  that  (4)  possesses  the 
two-time-scale  property  defined  by  (2)  and  (3). 


Lemma 

Given  system  model  (4)  let 

-d0  ”  An  —  AtlAtl~l  Au  (6) 

and  define  the  scalars 


3  *  IMu-1  /  ”  ll-^n^n  Ml»  a-Moll.  c  HM  n~i 

“/  •  !l-^itll>  bt~a  .  dt^a  +  bf,  d,a*a+6. 

If 

°^/i<c(dt*  +  8a6f) 

Then  there  exists  a  unique  Pfef?v>x-v*  satisfying 

such  that 

//,.\ 

St  (  ,  St  A  range  space 

\  P*  / 


(7) 


(8) 

(9) 


is  the  invariant  subspace  of  A  corresponding  to  fffin  +  iuP1).  Moreover, 
<t(A)  is  the  disjoint  union  of  <r(^4u  -  AltPt)'Uo(Atx  +  P*Alt).  Also,  if 


c(d*  +  Sabs) 
there  exists  a  unique  I>*ei?‘v*x‘v'  satisfying 


such  that 


’  *.v.  i 

a p*)t ) 


(10) 


(11) 

(12) 


is  the  invariant  subspace  of  AT  corresponding  to  <r(Au  +  PMu).  Moreover, 
<r(A)  is  the  disjoint  union  of  cr(An  +  P*A11)'Uo(An  —  AnP'). 


Proof 

An  application  of  results  obtained  in  Avramovic  (1979),  Kokotovic  (1976) 
and  Phillips  (1979).  An  outline  is  given  in  Appendix  B. 

Consider  now  the  transformation  on  (4) 

yi(k)~xt(k)  +  Ptxl(k) 


(13) 
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~xi(k+  1)' 

AU-AxtP<  -^n 

x\(k) 

+ 

‘  Bx  • 

y,(i+l) 

0  An  +  P*Alt_ 

Mk). 

_P1  +  PfP,_ 

where  P*  is  selected  such  that 

Rt(P<)  A  Atx  +  P‘Axl-AnP<-P<AxtP'-0  (14) 

Pf  transforms  (4)  into 

-  AxtPl  Atl  r  Bx  1 

u(k)  (15) 

To  complete  the  block  diagonalization,  let 

y^^x^fy-Qtytik)  (16) 

where  Q f  is  the  solution  to  the  Lyapunov  equation 

M„  -  AxtP')Q'  -  Q<(A„  +  Pf*4,t)  +  Au  =  0  (17) 

Iterative  techniques  (Avramovic  1979,  Kokotovic  1975)  for  obtaining 
solution  to  (14)  and  (17)  are  briefly  reviewed  in  Appendix  A.  Convergence  of 
the  iterative  algorithms  is  assured  for  every  /j,  satisfying  (7).  (13)  and  (16) 

give  a  net  transformation 

'/,  -  QiPt  -Q<~ 


y(k)~ 

which  has  the  explicit  inverse 
x(4)* 


P* 


■s  J 


h 


Q* 


x(k) 


y(k) 


(18) 


(19) 


L  -P*  It-P'Q 

This  will  be  called  the  ‘  F  '  transformation.  When  applied  to  (4),  this  trans¬ 
formation  gives 

In-^itP*  0  1 

y(k+i)  =  \  y(*)  + 


o 


*^2t  +  P^lt] 


(/  —  QtPt)Bx  —  QtBi 
PtBx  +  P, 


u(k)  (20) 


If  the  .4,2  block  has  been  removed  from  (4)  first,  a  dual  transformation  to  (16) 
results  which  will  be  called  the  ‘  <S  ’  transformation.  Let 


yi(k)~xx{k)  +  P'x,{k) 

where  P*  is  the  solution  to 

P,(P»)  A  .4lf  -  AnP*  -  P*AixP*  +  P’A„  =  0 
P*  transforms  (4)  into 


’yi(*+ 1)" 

.4,,  -i-  P*AXX 

0 

+ 

"  P,  4-  P*BX 

xt  (k  +  1)_ 

.41S  —  i4slP'_ 

.  B*  . 

(21) 

(22) 

u(k)  (23) 


To  complete  the  block  diagonalization 

yi(k)='Xt'*'-Q‘yl(k) 


(24) 
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where  Q*  is  the  solution  of  the  Lyapunov  equation 

(An-  AUP>)Q'  -  V(An  +  P»Aa)  +  An  =  0  (25) 

Again,  convergence  of  the  iterative  algorithms  for  obtaining  solutions  to 
(22)  and  (25)  is  assured  for  every  p  satisfying  (10).  This  transformation 
takes  the  form 

r  h  p'  i 

y(k)-  x(k)  (20) 

-Q*  le-Q'P'. 

which  possesses  the  explicit  inverse 

"fy-PV  -P»‘ 

x(k)  =  y(k)  (27) 

L  0*  h  J 

and  when  applied  to  (4),  the  transformed  system  takes  the  form 
Au  +  PsAji  0 

y(*  +  i)~  y(k) 

.  o  An  —  AxxPa_ 

B1  +  P*Bt 

+  u(k)  (28) 

_-Q*Bx  +  (I-Q*P')Bx_ 

It  is  easy  to  see  from  the  lemma  that 

11^11  A  OfyW),  ||P‘||4<V) 

If  we  let 

^u-;>p«  -  p»j  plpti.pt  (29) 

then  (20)  and  (28)  satisfy  the  two-time-scale  property  as  defined  by  (3),  since 
for  p  sufficiently  small 

!|MU  +pP*Atl)-'  ||  -*  >  -  AXXP*)  ((  (30) 

i(An-pAliPt)-ut'>p](An+  ^f.-ii,)||  (31) 

Inequalities  (30)  and  (31)  are  given  here  to  show  our  transformations 
lead  to  block  diagonalizations  that  are  consistent  with  our  norm  definition  of 
a  two-time-scale  system  (3).  The  set  of  values  of  p  that  satisfy  (30)  and  (31) 
will,  in  general,  be  a  subset  of  the  value  defined  by  (7)  and  (10)  respectively. 
In  the  remainder  of  this  paper  (7)  and  ( 10)  will  be  used  to  determine  if  the  system 
can  be  put  into  two-time-scale  block  diagonal  form.  It  should  be  noted  here 
that  bounds  obtained  from  norms  tend  to  be  conservative.  That  is,  the 
methodology  presented  here  is  applicable  to  some  systems  not  satisfying  (7) 
and  (10). 

4.  Reduced  order  modelling 

One  of  the  applications  of  singular  perturbations  is  the  ability  to  obtain  low 
order  well-conditioned  models  from  high  order  ill-conditioned  models  of  contin¬ 
uous  linear  systems.  The  approximation  made  in  obtaining  these  reduced 
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order  models  is  to  assume  that  the  real  part  of  the  stable  fast  eigenvalues  go  to 
minus  infinity.  Thus,  all  fast  modes  are  assumed  to  decay  instantaneously. 
In  the  discrete  case,  this  is  analogous  to  approximating  all  fast  eigenvalues  as 
‘  deadbeat  ’ ,  that  is  |  A  |  -  0.  For  model  (4),  this  means  approximating  the  group 
of  Nt  eigenvalues  clustered  within  an  0(p)  radius  of  the  origin  of  the  complex 
plane  as  zero  eigenvalues.  Thus, 


yt(fc)  =  0,  k>  0 

(32) 

and  from  the  ‘  F  ’  transformation 

(*).  *><> 

(33) 

x#)=-PV#),  k>  0 

(34) 

Applying  (33)  and  (34)  for  all  k,  our  reduced  order  model  becomes 

x(k  +  \)~A&(k),  fl(0)  =  x1(0) 

(36) 

and  the  ‘  fast  ’  states  appear  only  as  quasi  steady-state  functions  of 

£t(k)  =  -  P%(k) 

(36) 

In  (36),  we  eliminate  any  dependence  of  xt(k)  on  x*(0).  Thus,  from  fc  =  0  to 
some  k  =  fc*,  (30)  may  differ  considerably  from  the  actual  xt(k)  states.  Since  all 
fast  modes  are  stable  in  this  analysis,  the  question  is  not  whether  xt(k)  will 
converge  to  xt(k),  but  how  soon 

l*#)-*#)|  <y 

(37) 

for  some  y  >  0  and  k  >  0. 

The  interval  [0,  k*]  is  referred  to  as  the  1  boundary  layer  ’  in  the  analysis 
of  continuous  singularly  perturbed  systems  (Kokotovic  ei  al.  1976).  For  p 
small,  k*  can  be  as  small  as  1. 


Example 

From  Calovic  (1971),  the  discrete  model  of  a  steam  power  system  is  given 
as 


‘  0-9014 

0-1179 

0-0525 

0-0167 

0-02104  ' 

-0-0196 

0-8743 

0 

0-025 

0-02934 

x(fc+  l)  = 

-0-0071 

0-7342 

0-20175 

0-013 

0-21067 

-0-75 

-  0-0557 

-  0-032 

0-19357 

-0-014076 

-  0-300 

-0-01694 

-0-011 

0-14278 

0-013217 

This  model  was  found  to  fit  the  model  (4)  with  Nt  =  2,  2V,=  3.  The  corres¬ 
ponding  sub  matrix  norms  were 

Mull  *0-9415,  || dlt|| -0-0625,  ||AS1||  =0-8184,  ||AM||  =0-2441 

Condition  (7)  is  satisfied  with  0^0-259  25  <0-338  38.  Using  one  iteration 
of  the  P*  matrix  recursion 


JV 


-0-02583  -1-029 

1-0207  -0-09667 

0-4817  -0-06101 


(39) 
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we  obtain  the  slow  subsystem 


xa(k+  1) 


'  0-875521 
_  -  0-05932 


0-17486 

0-87798_ 


*.(*) 


which  has  eigenvalues 


(40) 


Ali2  =  0-876  75  +  0-101  84; 

which  compares  favourably  to  the  actual  eigenvalues  of  (38)  given  here  for 
comparison  purposes 

Aia -0-8777  ±0-1054; 

A,  =  0-0179 

A4J  =  0-2055  ±0-0236; 

The  entire  system  dynamics  of  (38)  will  now  be  simulated  using 
*i(*+l)  =  ^M#),  ^(Ol-a^O) 

where  the  remaining  three  states  appear  as  output  functions  or 

£t(lc)  =  -  iV  xx(k) 

To  compare  this  second  order  model  with  our  fifth  order  model,  the  response 
of  the  system  to  an  initial  perturbation  of 

;r0  =  ( 1 ,  -0-8,  0-5,  0-2,  0-6) 

is  plotted  versus  its  lower  order  approximation  (Figs.  1  to  5).  The  actual 
(high  order)  states  will  be  designated  *,(/(:),  while  the  approximated  state  will 
be  identified  by  x^k).  Using  just  one  iteration  of  Pkl  results  in  good  ivuracy. 


Figure  1.  Reduced  order  approximation  of  state  xx(k). 
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Figure  2.  Reduced  order  approximation  of  state  xt(k). 


5.  Control  law  design 

The  explicit  inverses  of  the  block  diagonalizing  transformations  and  the 
two-time-scale  nature  of  the  proposed  model,  enable  partial  or  total  pole  place¬ 
ment  to  be  carried  out  by  solving  reduced  order  pole  placement  problems. 
First,  two  cases  for  partial  pole  placement  will  be  covered.  Then,  a  two  stage 
design  for  total  pole  placement  will  be  outlined. 

Case  1 

Only  slow  eigenvalues  need  to  be  altered. 

Using  transformation  (21),  our  resulting  system  is  of  the  form  (23).  Let 
.4,  =■  ^l11  +  P%An  and  B,  =>  B,  -t-  P*B2  and  observe  that  the  pair  (A„,  B„)  spans 
only  the  ‘  slow  ’  controllable  subspace. 


Figure  3.  Reduced  order  approximation  of  state  *,(t). 


s 
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Design  <?s  such  that  the  eigenvalues  of  (A,  +  B,G,)  are  at  Ns  desired  loca¬ 
tions.  This  gives  a  closed  loop  system 


’yJfc+1)' 

{A*  +  BtGt)  0 

>l(*f 

Xjfifc+l). 

+  Atm 

.**(*). 

where  At=*  An-  AnP*. 

This  system  has  N,  eigenvalues  of  A*  ■+•  and  Nt  eigenvalues  of  At. 
The  feedback  control  takes  the  form 

u(k)  -  Gj/X(k)  (42) 

-[  G,\GtP*yc{k) 


Figure  5.  Reduced  order  approximation  of  state  x5(/fc). 
con.  2  D 
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Case  2 

Only  fast  eigenvalues  need  to  be  altered. 

Using  transformation  (13),  we  obtain  the  upper  block  triangular  system 
(15).  Let  At  =  Au  +  PtAlt  and  Bt-  Bt  +  PtB1  and  observe  that  the  pair 
(.4,,  Bt)  spans  only  the  fast  controllable  subspace. 

Design  Gt  such  that  the  eigenvalues  of  (At  +  BtGc )  are  at  Nt  desired  locations. 
This  gives  a  closed  loop  system 


*2^4  +  1)' 

A,  Alt  +  BxGt 

~xx(ky 

(43) 

Ut(*+i)J 

0  At  +  BtGf 

.Fit*). 

where  <4,»  -AltI». 

This  system  has  N,  eigenvalues  of  A,  and  Nt  eigenvalues  of  At  +  BtGt. 
The  feedback  control  takes  the  form 


u(k)  -  Gtyx(k) 

-[GtP*\Gt\z{k)  (44) 

If  the  design  requirement  entails  moving  both  slow  and  fast  eigenvalues, 
then  a  two  stage  procedure  can  be  implemented. 

Given  a  system  of  form  (4)  that  has  been  put  into  block  diagonal  form  via 
either  the  ‘  S  ’  or  ‘  F  ’  transformation, 


'y^k+1)' 

X  O' 

'yi(k)‘ 

4* 

'b; 

_yt(k+l)_ 

. 0  At 

.2/#). 

.Bt. 

(45) 


We  can  design  for  either  slow  or  fast  subsystems  pairs  (4,,  Bs)  or  (.4,,  Bt). 
Arbitrarily,  the  pair  (A„  B,)  is  selected  first. 

Find  a  feedback  gain  Gt  such  that  A^  +  B^G,  has  Nn  desired  ‘  slow  ’  eigen¬ 
values.  The  resulting  partially  closed  loop  system  is  of  the  form 


where 


'y^k+lf 

, 

A,  +  BtG,  0 

’yi(k)' 

+ 

'b; 

Ji(k+  1)_ 

BtG„  At_ 

.y»(*). 

.Bt. 

ut(k) 


(46) 


Now,  let 


**(£)- j/tW-SyiW 


(47) 


which  results  in 


zt(k  + 1 ) « [BtGt  +  A(S  -S(A,  +  B,Gn)]l/i{k)  +  +  (B,  -  SBt)ut{k) 

Choose  S  such  that 

AtS~S(A,  +  B,Gt)  +  BtQ,-0  (48) 

This  Lyapunov  type  equation  has  a  unique  solution  if 

a(-4t)n«7(d,  +  BSGS)  -  <f> 


(49) 
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Thus,  one  of  the  design  requirements  of  the  first  stage  is  that  the  desired 
slow  spectrum  be  disjoint  from  the  open  loop  fast  spectrum.  The  solution  to 
(48)  can  be  found  iteratively  like  Q (  and  Q*  or  algebraically  (Bartels  and 
Stewart  1977).  (48)  now  becomes 


'^(fc+1)' 

■4i  +  .B,£i!1  0 

+ 

‘  5.  ' 

_2,(k+l) 

0  A, 

.  **(*). 

Bt-8Bim 

Now,  design  a  feedback  gain  Gt  such  that  (At  +  (Bt-8B,)Gt)  has  Nt  desired 
eigenvalue  locations. 

The  composite  feedback  is  of  the  form 

u(k)  -*,(fc)  +  «f(i) 

-  6dh(k)  +  Gt*«(*) 

-  («.-«,-%#)  + <?#,(*)  (51) 

Depending  on  whether  the  ‘  S  ’  or  ‘  F  '  transformation  was  used,  y^k)  and 
yt(Jfc)  can  be  expressed  as  functions  of  our  original  states.  For  example, 
using  the  ‘  8  ’  transformation 

yi(jfc)-[/:p*]x(ifc) 
y*(*)  «[-«•:/ 

and  (51)  becomes 

u(k)  -  [(?,  -  Gt(S  +  Q‘) :  GtP*  +  Gt~  Gt(8  +  Q*)P»]x(fc)  (52) 

which  places  Nt  eigenvalues  of  (4)  according  to  A(^i,  +  B3G3)  and  Nt  eigenvalues 
according  to  Af-dj  +  f-Bj-S-B,)^). 


Example 

The  discrete  model  of  an  eighth  order  power  system  (Calovic  1971)  is  given 
as 


‘  0-835 

0 

0 

0 

0 

0 

0 

0 

0-096 

0-881 

0 

0 

0 

0 

0 

0-029 

-0-002 

-0-005 

0-882 

-0-253 

0-041  - 

0-003 

-0-025  - 

0-001 

0-007 

0-014 

-0-029 

0-928 

0 

0-006 

0-059 

0-002 

-0-03 

-0-061 

2-028 

-2-303 

0-088  - 

0-021 

-0-224  - 

0-008 

0-048 

0-758 

0 

0 

0 

0-105 

0 

0-023 

-0-012 

-0-027 

1-209 

-1-4 

0-101  - 

0-013 

0-156 

0-006 

0-813 

0 

0 

0 

0 

0 

0 

0-011 

> 

0 

0-294  - 

-0-038 

2-762 

0 

1-473 

0 

3-295 

0-152  - 

0-003 

0-01 

-0-051 

0-056 

-0-015 

2-477 

which  is  of  the  form  (4),  with  N3 »  Nt  —  4,  and  ^*0-259  04. 
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After  three  iterations, 


0-012 

0-035  -2-102 

1-8091 

0-095 

-1-083  0 

0 

P s'- 

- 

-0-020 

-0-006  -2-168 

1-546 

-0-909 

0  0 

0 

J 

“ 

0 

0  0 

0 

0 

0  0 

-0-034 

— 

0-043 

0  -0-005 

0 

- 

0-004 

-0-009  -0-109 

-0-003 

The  slow  subsystem  is  given  as 

'0-835 

0  0 

0 

0-126 

0-861  0 

0 

0-004 

-0-009  0-913  - 

0-288 

0-010 

0-021  0-098 

0-836 

'0 

0  0-394 

0-054' 

5,T 

- 

3-295 

0-125  -  0-002 

0-003 

The  desired  slow  eigenvalues  are 

At  j(Des)  -0-9  ±  0-05.; 

VDes)-0-85 

A4(Des)-0-8 

and  the  feedback 

0-032 

-0-01  0 

0 

1 

G, 


-0-069  -  0-027  -  0-347  0-676 


places  the  eigenvalues  of  An+  B,G%  at  these  desired  locations. 
This  gives  S  as 


‘ -0-170 

-0-121 

— 1-013 

1-508 

0-01 

-0-003 

0 

0 

-0-134 

-0-131 

-0-904 

1-076 

-0-028 

0-008 

0 

0 

(55) 


(56) 


(57) 


(58) 


(59) 


(60) 
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and  the  resulting  fast  subsystem 


'0-003 

-0-005  - 

0-064 

0 

At- 

0 

0-165 

0 

-0-009 

0-07 

0-001 

0-302 

0-011 

0 

0 

0 

0-011  _ 

'2-392  0 

_  0-587  0-176 

1-074 

0-394 

0 

-0-692 

The  desired  fast  eigenvalues  are 


(61) 


(62) 


and  the  feedback 


Aj^Des)  -0-2  ±0-01  j 
A,(Des)-0-15 
A((Des)-0-l 


-0-039  0 

0-010  —  0-052 


-0-333' 

0-029_ 


(63) 


places  the  eigenvalues  of  At  +  (Bt  —  8Bt)TGt  at  these  desired  locations. 

The  composite  feedback  analogous  to  (52),  places  the  closed  loop  eigen¬ 
values  at 

\  ,(CL)«  0-900  ±0-061  j 
A,(CL)«  0-846 
A4(CL)-  0-799 
Aj^CL)  -0-199  ±  0-0Uj 
AT(CL) -0-161 
A,(CL)«  0-093 


Thus,  a  maximum  error  of  7-3%  after  3  iterations,  and  an  absolute  error  well 
within  the  convergence  rate  bound  0(ji*),  where 


/**- 0-017 


6.  Conclusions 

A  model  for  a  class  of  discrete  systems  having  a  two-time-scale  property 
has  been  defined.  By  satisfying  certain  subsystem  norm  conditions,  reduced 
order  models  may  be  derived  without  a  priori  knowledge  of  the  eigenvalues  of 
the  system.  This  is  appealing  to  exceptionally  large  discrete  systems  (i.e. 
economic,  sociological,  etc.)  where  the  computation  of  eigenvalues  may  be 
impossible.  Dual  block  diagonalizing  transformations  are  used  to  obtain 
reduced  order  fast  and  slow  models.  Order  reduction  is  achieved  by  approxi¬ 
mating  the  fast  modes  at  deadbeat.  Thus,  the  original  fast  states  are  approxi¬ 
mated  as  quasi  steady  state  output  functions  of  the  slow  states.  Partial  or 
total  pole  placement  for  the  higher  order  system  is  implemented  using  designs 
based  on  the  reduced  order  fast  and  slow  subsystems. 
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Appendix  A 

Iterative  techniques  to  obtain  solutions  to  (14),  (17),  (22),  and  (25)  appeared 
in  Avramovic  (1979)  and  Kokotovic  (1975).  The  subspace  method  (Avramovic 
1979)  leads  to  the  following  matrix  recursion  equation  for  P* 

Pk+S  «  PS  -  *APMA u  -  AltPk*)~x  (A  1) 

P </•”  —  AtlAxx~x  (A  2) 

In  the  case  of  (4),  the  convergence  of  (A  1)  is  guaranteed  for  all  fi  satisfying  (7) 
and  the  convergence  rate  will  be  0(/t*)  since 


sup  |<r(AM  +  .PfAlt)| 
inf  j uMu-AuP1)! 


A0(M) 


(A  3) 


A  computationally  more  efficient  form  of  (A  1)  is  proposed  in  Kokotovic 
(1975),  where  the  approximation 


(A  4) 


leaves  (A  1)  in  the  form 

Pk+S  “  (AnP S  +  P k  An Pk  ~  A«)AU-1  (A  5) 

which  possesses  the  same  local  convergence  properties  of  (A  1).  Bounds  on 
p  for  the  convergence  of  (A  5)  have  been  considered  in  Phillips  (1979). 

The  subspace  method  of  Avramovic  (1979)  can  be  extended  to  find  an 
iterative  solution  for  P*.  This  is  seen  by  letting  P*  =  MX~X  Mt,  where  the  rows 
of  are  left  eigenvectors  of  the  system  matrix  in  (4)  spanning  the  domi¬ 

nant  Nt  dimensional  eigenspace.  The  iterative  solution  can  then  be  shown  to 
be  of  the  form 

Pk+ S  -  PS  +  (A„  +  PS  A„)-1  •  R,(PS)  (A  6) 

PS~An~lAlt  (A  7) 

The  conditions  for  convergence  and  the  convergence  rate  of  (A  6)  are  analogous 
to  those  of  (A  1). 

Again,  from  Kokotovic  (1975),  making  the  approximation 

(Au  +  ,uiy  itl)-i*Au-‘  (A  8) 

(A  6)  becomes 

Pk+Sm  Ali-1(A1J  +  i> j.*  An  — P i*  AnP k*)  (A  9) 

which  is  also  considered  in  Phillips  (1979). 
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Solutions  to  (17)  and  (25)  have  been  well  documented  and  can  be  found 
algebraically  (Bartels  and  Stewart  1977)  or  recursively  (Kokotovic  1975). 
From  Kokotovic  (1975),  the  following  successive  approximations  converge 
under  mild  bounds  at  an  0{p*)  rate 


Qk+i  *  Au~'{AltP<Qk<  +  &*(  —  ■dit)  (A  10) 

Qol  m  ~  An-1  Au  (A  11) 

Qk+ 1*  *  (M*j  —  AuP*)Qk*  —  Qh*  P*Ati  +  A^Au"1  (A  12) 

Qo‘  **  (A  13) 

In  the  example  (A  10)  and  (All)  have  been  used. 
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The  existence  of  an  equilibrium  solution  to  (A  5)  is  guaranteed  if  /i  is  bounded 
by  (7)  which  also  establishes  (8).  These  results  were  first  derived  in  Kokotovic 
(1975)  and  applied  to  discrete  systems  in  Phillips  (1979).  However, 
Avramovic  (1979)  has  shown  that  (A  5)  is  a  simplified  form  to  the  matrix 
recursion  (A  1)  in  that  convergence  of  (A  5)  assures  convergence  of  (A  1)  to  an 
equivalent  result.  From  Avramovic  (1979),  the  sequences  of  (A  1)  are  shown 
to  be  equivalent  to  the  sequences  of  the  following  simultaneous  iteration  for 
computing  the  basis  of  a  dominant  eigenspace  of  A 


where 


Vk+1  *  A  VkSk 


V 


Vzk. 


and  Sk  is  a  scaling  matrix.  Thus, 


(A  14) 


*v--p,wri  (a  is) 

and  the  spectrum  separation  property  and  (8)  are  established. 

The  existence  of  an  equilibrium  solution  to  (A  9)  is  guaranteed  if  y.  is  bounded 
by  ( 1 0)  which  also  establishes  (11).  The  left  eigenvector  approach  to  the  deriva¬ 
tion  in  Avramovic  (1979)  results  in  (A  0)  and  (A  7)  of  which  (A  9)  has  been 
shown  to  be  a  simplified  form.  Thus,  the  dominant  eigenspace  iterations  of 
Avramovic  (1979)  can  again  be  applied  in  analogous  fashion  to  establish  (12) 
and  the  spectrum  separation  property. 
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Multi-Time-Scale  Analysis  of  a  Power  System* 

JAMES  R.  WINKELMANt,  JOE  H.  CHOWt,  JOHN  J.  ALLEMONGJ 
and  PETAR  V.  K0K0T0VIC§ 

Singular  perturbations,  applied  to  a  model  of  a  three  machine  power  system, 
provided  reduced  models  which  yield  good  eigenvalue  and  time  response  approxi¬ 
mations  of  the  original  system. 


key  Words  Computational  method*;  time  scale  modeling:  system  order  reduction:  iterative  methods; 
power  system  simulation;  dynamic  response;  large  scale  systems. 


Abstract — A  time-scale  separation  procedure  is  outlined  and 
applied  to  a  three  machine  interconnected  power  system 
modcied  with  iiu.t  linkage  and  voltage  regulator  dynamics. 
Partial  models  such  as  the  electromechanical  model  and 
single  machine-infinite  bus  model  are  used  to  identity  the  slow 
and  fast  states  of  the  systems.  Linear  simulation  results  in 
t«o-  and  four- time-scales  demonstrate  the  potential  applica¬ 
bility  of  the  singular  perturbation  approach  to  long-term 
dynamic  studies  of  power  systems. 

t.  INTRODUCTION 

This  paper  presents  an  application  of  the  singu¬ 
lar  perturbation  method  for  separation  of 
time  scales  described  in  a  companion  paper 
(Kokotovic  and  co-workers,  1980).  A  linearized 
20th  order  model  of  a  three  machine  power 
system  with  realistic  data  is  analyzed  in  two-  and 
four-time-scales.  The  model  includes  the  elec¬ 
tromechanical,  flux  linkage  and  excitation  system 
dynamics.  Following  an  electrical  disturbance  the 
model  exhibits  a  rich  frequency  spectrum  of 
restoring  motions.  Due  to  the  strong  interactions 
between  machines,  the  individual  machine  vari¬ 
ables  are  found  to  be  mixed  and  hence  is  not 
suitable  for  direct  state  separation  into  a  slow 
and  a  fast  subsystem.  The  identification  and  the 
reformulation  of  the  slow  and  fast  variables  are 
therefore  among  the  major  problems. 

A  state-space  model  of  a  multi-time-scale  sys¬ 
tem  is  s<  d  to  be  state  separable  if  the  fast  parts 
of  some  of  its  states  are  small  compared  with  their 
slow  parts  and  with  the  fast  parrs  of  the  other 
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states.  The  fast  parts  may  arise  due  to  either 
modes  that  are  wdl-damped.  that  is.  eigenvalues 
with  large  negative  real  parts,  or  high  frequency 
oscillatory  modes,  that  is,  eigenvalues  with  large 
imaginary  parts.  Such  models  can  be  put  in  the 
standard  singular  perturbation  form  (Kokotovic. 
O'Malley  and  Sannuti.  1976)  and  the  time  scale 
separation  method  discussed  in  the  companion 
paper  is  directly  applicable.  However,  in  a  large 
scale  system  the  situation  is  more  complex.  Even 
if  the  subsystem  models  are  state  separable,  their 
interconnections  may  introduce  new  phenomena 
and  change  the  speeds  of  some  of  the  states. 
Then  a  new  choice  of  state  variables  may  be 
needed  to  make  the  interconnected  model  state 
separable.  An  example  is  the  angle  transfer- 
mation  used  here  to  deal  with  electromechanical 
interactions.  To  make  the  determination  of  fast 
and  slow  states  more  systematic,  we  propose  the 
following  separation  procedure.  First,  we  study 
readily  identifiable  phenomena,  in  this  case  the 
electromechanical  interactions  and  the  single  ma¬ 
chine  characteristics  to  identify  the  fast  and  slow 
slates.  The  next  step  is  to  apply  the  iterative 
scheme  to  validate  the  choice  of  the  slow  and  fast 
variables  and  to  improve  the  accuracies  of  the 
slow  and  the  fast  subsystem. 

The  paper  is  organized  as  follows.  The  model 
of  the  three  machine  system  is  given  in  Section  2. 
The  separation  procedure  >s  proposed  in  Section 
3.  Time  scales  of  the  electromechanical  model  are 
discussed  in  Section  4.  In  Sections  5  and  6.  the 
full  model  is  analyzed  as  a  iwo-time-scale  system 
and  the  simulation  results  are  discussed  in 
Section  7.  Section  3  is  an  extension  to  a  four- 
nme-scale  analysis. 

:.  THE  TEST  SYSTEM 

For  the  three  machine  test  system  in  Fig.  1  the 
disturbance  ot'  interest  ts  a  five  cycle  three  phase 
fault  on  bus  8  followed  by  the  loss  of  line  S-9 
Constant  impedance  loads  are  assumed.  The  six 
electromechanical  equations  are 
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4,-377(01,-1)  i-1.2,3  (1) 

2 Hi  |_w, 

-  I  K^y./cos(0i>+«5;-di)j 

y-i  J 

/-i.2.3  (2) 


where  V-  are  generator  voltages,  Yy£0 y  intercon¬ 
necting  admittances,  D,  damping  terras,  Pi 
mechanical  input  powers  and  Ht  inertias. 
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where  Efdi  is  field  voltage  and  the  currents  arc 
y 

-  I  ^f^cosiO.y 4-0—0,) 
y*  i 

-e>,ysin  (Oi;  4-<Jj  (5) 

J 

I  ^yC<3  COSt«,y  +  <>;-«>,) 
i«l 

sin  <j,)].  (6) 

The  machine  data  are  given  in  Table  I. 


TaRLE  1.  SYNCHRONOUS  MACHINE  DATA  MOO  MVA  BASE) 


Pi  rue  ter 


K  (arc) 


D  (pu) 


V*“> 


XqCpu) 


X^Cpu) 

X’fpu) 


X’(pu) 


Machine  9 

I 

2 

3 

23.64 

6.4 

3.01 

9.6 

2.5 

1.0 

0.6 

0.8958 

0.9 

0.38 

0.8645 

0.85 

0.056 

O.UO 

0.18 

0.0608 

0.1198 

0.1813 

0.0608 

0.1198 

0.1813 

4.0 

6.0 

5.0 

0.25 

0.54 

0.65 

The  same  IEEE  Type  l  voltage  regulator 
(IEEE  Committee  Report,  1968)  is  used  for  all 
machines  with  the  exponential  saturation 
function 

S£l£/d)a,<4Mlexp[B,»(£/'.i]  (') 

retained  but  limit  type  nonlinearities  neglected. 
The  amplifier,  exciter  and  feedback  compensator 
equations  arc.  for  i  *  1, 2. 3 
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and  their  parameters  are  listed  in  Table  2. 
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Taihj  1  Voltage  hcgclatoe  constants 


im  2, ....  it.  and  obtain 


r, -0.06*  K,  - -0.0445 

Tc  m0.5t  Kr  m  0.16 

r, -1.0  s  A„m  0.00*  t  '3 

Ktm2S  0.3043 


*.4  *  BLk 

Ck-C-DLk  +  LkAk  117) 

Dk  -  D  LkB. 


This  model  is  described  by  twenty-one  differen¬ 
tial  equations  whose  linearized  form  will  be  ana¬ 
lyzed  in  two-  and  in  four-time-scales.  U  is  well- 
known  that  for  machines  with  non-uniform 
damping,  the  system  order  can  be  reduced  by  one 
as  one  of  the  angles  can  be  used  as  a  reference 
(Prabhakara  and  El-Abiad,  1975).  However,  for 
illustrative  purposes,  we  use  the  individual  ma¬ 
chine  angles  and  eliminate  the  extraneous  angle 
variable  only  after  we  have  introduced  the  angle 
transformation.  This  model  will  be  referred  to  as 
the  full  20th  order  model. 

3.  THE  SEPARATION  PROCEDURE 
The  iterative  scheme  developed  in  the  com¬ 
panion  paper  starts  with  a  model  in  the  state 
separable  form 


U2) 


where  x  is  predominantly  slow  and  :  contains 
fast  transients  or  oscillations  superimposed  on 
slowly  varying  ijuasi-steady-state  (qss).  Note  that 
the  scale  factor  s  is  incorporated  in  C  and  D  (see 
Remark  in  Section  4  of  the  companion  paper). 
This  full  system  is  then  decomposed  into  a  slow 
subsystem 


and  a  fast  subsystem 

'll.  *  Dklnh,  (H) 

and  the  original  variables  x  and  ;  are  approxi¬ 
mated  by 


-tr >**?►■“£•*•**/  (15) 


Then,  we  compute  HkJ  from 

Hki  «  BD : 1  +  lAt  -  Hki . ,  Ck)Hu 

//,,-BDf  (13) 

i»  2....J,  and  obtain 

Akj»Ak  —  HkJCk 

3kj~B-HklDk±AklHkj  1 19] 

Ok/ »  Dk  4-  Ck/fky. 

The  iterations  1 16).  (17)  are  used  for  correcting 
the  fast  variables  i;k  and  (18),  (19)  for  the  slow 
variables  l,.  Different  /  and  k  are  possible  de¬ 
pending  on  the  accuracy  requirements  for  the 
slow  and  the  last  variables.  If  a  better  accuracy  of 
the  slow  variables  is  required  while  some  in¬ 
accuracy  of  the  fast  variables  can  be  tolerated, 
then  a  few  more  //-iterations  are  used  and  vice 
versa.  Note  that  the  quasi-steady-state  models  as 
defined  in  the  companion  paper  is  obtained  by 
substituting  .4,,  D,  0  and  L,  for  AkJ.  Dk>,  Hk>  and 
Lk  in  ( 1 3)— ( 1 5). 

In  contrast  to  modal  analysis.  ,-lkJ  and  Dkj 
approximate  the  slow  and  the  fast  modes  of  il2), 
respectively,  in  groups  rather  than  individually. 
There  are  two  distinct  advantages  in  this  ap¬ 
proach.  First,  (15)  indicates  that  ^  retains  the 
physical  nature  of  the  original  variable  x  while  i;k 
retains  that  of  the  variable  r.  Second,  the  ex¬ 
pressions  (16M19)  for  Atj  and  Dk;  are  expressed 
in  terms  of  the  original  matrices  A,  B.  C  and  D. 
and  the  calculations  are  straightforward.  The 
price  to  be  paid  for  these  advantages  is  that  a 
model  has  to  be  in  a  state  separable  form  (12).  In 
this  paper  we  demonstrate  how  this  is  done  in 
practice  using  a  5th  order  electromechanical  mo¬ 
il  and  a  20th  order  model  of  the  test  system. 

The  separation  procedure  which  we  follow  in 
the  examples  consists  of  two  phases. 


where  k  and  j  denote  the  number  of  iterations 
performed  on  the  fast  and  slow  variables, 
respectively. 

For  completeness,  we  summarize  the  iterative 
procedure  (57),  (53)  in  the  companion  paper  as 
follows.  We  first  compute  Lk  from 

L,~  D~  'C  *D~ 1 L,.  ,(A  —  BLi- , )  L,-0*'C 

(16) 


Modeling  phase.  As  is  the  case  in  power  sys¬ 
tems.  large  scale  systems  often  are  composed  of 
individual  systems  having  the  same  types  of 
components.  If  these  individual  systems  are 
weakly  interconnected,  the  slow  and  last  states  o<‘ 
the  overall  system  could  be  obtained  by  determin¬ 
ing  the  slow  and  fast  states  of  the  individual  systems. 
However,  it  is  usuaily  the  case  that  intercon¬ 
nections  result  in  an  altering  of  the  slow  and  fast 
variables  as  determined  from  the  study  of  the 
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individual  systems.  As  a  result  transformations 
may  be  required  to  put  the  total  system  into  state 
separable  form.  This  may  be  achieved  by  a  global 
study  of  the  appropriate  interacting  components. 
Such  a  study  wilt  allow  us  to  propose  candidates 
for  the  slow  states  x  and  the  fast  states  :. 

Validation  phase.  Norm  conditions  such  as 
those  in  Kokotovic  (197S)  usually  yield  con¬ 
servative  results  and  hence  are  not  used  here. 
Experience  has  shown  eigenvalues  to  be  a  better 
indication  of  convergence.  Given  a  proposed  mo¬ 
del  in  the  form  (12)  the  qss  model  and  models 
obtained  by  using  the  iterative  method  with  one 
or  two  levels  of  correction  1  or  2)  are 

used  in  this  validation  phase.  If  the  increments  of 
the  eigenvalues  in  successive  /4ky  or  DkJ  are  small 
then  the  choice  of  slow  and  fast  variables  is 
adequate.  Otherwise,  a  different  selection  of  states 
is  required,  that  is,  a  return  to  the  modeling 
phase.  Alternatively,  eigenvectors  of  Akj  or  DkJ 
may  be  used  to  indicate  convergence. 


machine  against  an  infinite  bus.  Finally  the  fas¬ 
test  is  the  motion  of  the  two  smaller  machines 
relative  to  each  other.  These  motions  are  better 
exhibited  in  a  new  set  of  variables 


and  a  similar  set  of  variables  t u„  w,  in  terms 

of  wt.  os-i,  «j.  Since  the  dynamics  of  the  other 
five  variables  do  not  depend  on  d„  this  angle  is 
not  included  and  the  model  reduces  to  fifth 
order.  The  «,  coordinate  (20)  is  commonly  used 
in  stability  analysis  (Stanton,  1972:  Luini.  Schulz 
and  Turner.  1975).  The  linearized  post-fault  sys¬ 
tem  is 


"Aw,"]  p  0.198  0.00756  0.00486 

A£,  0  0  377 

Aw,  -  0.0122  -  0.133  -  0.191 

A <5,  0  0  0 

Aw,  -0.292  0.163  -  0.0292 


0.00733  -  0.0018  FI  [~Aw7 
0  0  Ad, 

0.0304  -  0.00454  Aw,  .  (21) 

0  377  Ad, 

-0.426  -  0.175  Aw, 


The  models  (13)  and  (14)  which  passed  the 
validation  phase  may  be  iteratively  improved 
using  ( 16)— <  19)  to  match  the  needs  of  applications 
such  as  simulation  in  two-time-scales  and  decom¬ 
posed  control  design.  In  this  paper,  only  the 
linear  simulation  results  are  presented.  The  above 
procedure  can  be  extended  to  muiti-time-scales 
by  a  repeated  application  of  the  two-time-scale 
procedure. 


i  THE  ELECTROMECHANICAL  MODEL 
it  can  be  expected  that  the  time  scales  in¬ 
troduced  in  the  single-machine  analysis  in  Section 
5  of  the  companion  paper  will  have  to  be 
modified  here  primarily  due  to  electromechanical 
interactions  between  the  machines.  These  interac¬ 
tions  are  considered  first  by  assuming  that  the 
voltage  Vt.  V2,  V3  in  (1),  (2)  are  constant.  From 
the  fault  location  and  the  physical  parameters  of 
the  system,  three  different  speeds  of  system  dy¬ 
namics  are  to  be  expected.  The  slowest  is  the 
motion  of  the  whole  system  as  a  single  unit.  The 
second  is  the  motion  of  the  two  smaller  machines 
moving  together  against  the  center  of  inertia, 
which  is  analogous  to  the  motion  of  the  single 


To  test  whether  this  model  can  be  separated 
into  three  subsystems,  we  apply  the  iterative 
scheme  to  decompose  (21)  into  the  slow  sub¬ 
system  (Aw,.  Ad,.  Aw,)  and  the  fast  subsystem 
(Ad,,  Am,L  and  then  further  decompose  the  slow 
subsystem  into  two  subsystems  (Aw,)  and  (Ad.. 
Aw,).  The  qss  models  are 


Aw,»  -0.199 Aw, 


Since  the  order  of  the  full  system  is  small  we 
compare  the  eigenvalues  of  the  qss  models  di¬ 
rectly  to  the  eigenvalues  of  the  full  system.  As 
Table  3  shows,  their  eigenvalues  approximate  the 
eigenvalues  of  the  full  model  (21)  within  2°,. 

This  excellent  separation  of  the  time-scales 
motivates  the  use  of  the  variables  (20)  in  the  20th 
order  system. 

5.  TWO-TIME-SCALE  MODELING 
Now  we  proceed  lo  perform  a  two-lime-scale 
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Tails  3.  Ekknvaiuis  or  ths  rvu.  moosl  Cl) 

AMO  THS  SUMYSTIMS  C2) 


Full  modal 

qw  modd* 

-aiw 

-A199 

-0.09W-lj6.09 

-0.096J±;6A0 

-0.0$S7±;119 

-0.0877t;tZ7 

decomposition  on  the  full  20th  order  model.  The 
choice  of  the  slow  and  fast  variables  for  this 
model  will  be  based  on  the  results  obtained  from 
two  partial  models,  namely,  the  single  machine 
model  in  the  companion  paper  and  the  elec¬ 
tromechanical  model  in  the  previous  section. 

In  the  7th  order  single  machine  model  using 
data  dose  to  those  of  machine  2.  the  variables 
(Ae^,  Ail/)  have  been  identified  as  slow  and  the 
other  variables  (A*;,  A<5,  Am,  A/,.  A £/*)  as  fast. 
Similar  condusions  are  obtained  using  data  from 
each  of  the  three  machines.  On  the  other  hand, 
the  electromechanical  model  from  Section  4 
exhibits  one  state  (Am,)  whose  speed  is  compar¬ 
able  to  A*^  and  A Rr.  and  four  states  (A<j^.  Amc, 
Ad*.  Am*)  whose  speeds  are  comparable  with  the 
fast  variables  in  the  single  machine  model. 

Whether  the  choice  of  states  suggested  by  the 
two  partial  models  is  applicable  to  the  full  model 
depends  on  the  interactions.  From  this  point  of 
view,  the  voltage  regulator  variables  At',,  and 
A £/*,  should  be  retained  as  fast,  and  A Rfl  as 
slow  in  the  full  modeL  Furthermore,  the  Am, 
variable  is  assigned  to  the  slow  time-scale  and 
Ad,,  A mc.  Ad*.  Am*  are  assigned  to  the  fast  time- 
scale.  Their  interaction  with  the  voltage  regulator 
is  known  to  significantly  change  the  damping. 


but  not  the  frequencies.  The  decision  on  the 
remaining  A*,,,  A**,  is  considerably  more  com¬ 
plex  and  likely  to  depend  on  the  parameters  of 
the  specific  system.  The  single  machine  sepa¬ 
ration  of  A*,,  as  slow  and  A*i,  as  fast  seems  a 
good  starting  point  for  systems  with  weak  and 
moderate  interactions. 

In  view  of  the  above  discussion,  we  propose 
the  (7.  13)  decomposition 

.xT •  (Am,,  A*',,  Ail/,,  Aetj,  Ail /j,  A(*j,  Ail/j)T 

2T»(Aei,,  A*ii,  A«f*j,  Adt,  Amc.  At',,.  A £/*,, 

A  I',-.  A  £/*,.  Ak^.  A£/jj.  Ad.,,  Am*)t.  1 23) 

The  system  matrix  for  this  ordering  of  the  states 
is  given  in  Fig.  2. 

A  particular  merit  of  this  grouping  of  state 
variables  is  that  t  contains  the  system  frequency, 
all  the  slow  flux  linkage  variables  and  all  the 
slow  regulator  modes,  while  :  contains  all  the 
fast  flux  linkage  variables,  the  fast  regulator 
modes  and  the  swing  modes.  This  grouping  of 
variables  of  similar  physical  nature  simplifies  the 
identification  of  the  slow  and  fast  variables.  With 
the  slow  and  fast  states  tentatively  identified,  we 
may  proceed  to  the  validation  phase  immediately. 
Note  that  the  above  decomposition  does  not 
depend  on  the  knowledge  of  the  exact  eigen¬ 
values  of  the  full  system. 

An  alternative  approach  is  possible  if  the  exact 
eigenvalues  are  given  as  they  are  in  Table  4. 
Then  we  first  note  that  there  is  a  gap  between  the 
7  small  eigenvalues  and  the  13  large  eigenvalues, 
and  hence,  the  order  of  the  slow  subsystem  is 
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Tam. 1 4.  Eiccnvaluc  aho  emiNvicroe  asvsoximations  or  tm«  7.13  oscom  position 
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tentatively  set  at  7,  while  that  of  the  fast  sub¬ 
system  is  set  at  13. 

To  identify  the  slow  and  fast  variables,  we 
attempt  to  correlate  groups  of  eigenvalues  of  the 
partial  models  with  the  exact  eigenvalues.  For 
example,  the  swing  modes  are  recognizable  in 
Table  4  by  being  close  to  the  swing  modes  in 
Table  3.  To  be  specific,  the  pair  - 1.42  ±jl  1.1 
corresponds  to  the  intermachine  swing  modes 
A<j<,  A<u*  the  pair  -  0.759  ±y4.63  corresponds  to 
the  center  of  swing  A<5C,  Acof  of  machines  2  and  3. 
and  the  mode  -0.243  corresponds  to  the  system 
frequency  A <u,.  Note  that  the  inclusion  of  voltage 
regulators  has  improved  the  damping,  but  does 
not  significantly  alter  the  frequencies  of  these 
modes. 

Another  group  of  eigenvalues  which  can  also 
be  easily  correlated  are  the  pairs  -8.l7±/7.70, 
-%M±jS.06  and  -8.55±;'8.24,  which  corres¬ 
pond  to  the  fast  voltage  regulator  modes  A  l'*,, 
A Efil  (see  the  companion  paper).  Furthermore, 
the  modes  -7.36.  -4.17  and  -2.11  are  close  to 
the  eigenvalues  -9.16.  -5.64  and  -2.56  of  the 
3x3  A**  submatrix  obtained  from  the  A  matrix, 
implying  that  they  are  associated  with  Aej,.  The 
remaining  eigenvalues  therefore  correspond  to  the 
A*i„  A R,  modes.  This  analysis  deals  with  groups 
of  modes  rather  than  the  individual  modes.  The 
same  7  slow  and  13  fast  state  separation  (23)  is 
obtained. 

6.  TWO-TIME-SCALE  VALIDATION 

We  now  apply  the  iterative  scheme  to  validate 
the  choice  of  the  slow  and  the  fast  variables  by 
comparing  the  eigenvalues  of  the  qss  models  with 
the  eigenvalues  of  the  first  and  second  level 
corrected  models  (It -j- 1,2)  given  in  Table  4. 
The  eigenvalue  approximation  between  the  qss 
models  and  the  first  level  (kmjmi)  corrected 


models  is  within  11%.  Between  subsystems  with 
first  level  corrected  models  and  second  level 
corrected  models  (fc»/»  2),  the  increment  is 
within  5  %.  This  indicates  that  the  choice  of  state 
variables  (23)  for  the  fast  and  slow  subsystems  is 
appropriate.  Note  that  even  though  the  fast-slow 
ratio  defined  as  |  —2.11  j/|  -  1.14£yQ.866|  - 1.5  is 
not  much  larger  than  one,  the  iterative  scheme  is 
still  applicable. 

We  now  illustrate  how  eigenvectors  may  be 
used  as  an  indication  of  convergence.  For  real 
eigenvectors,  we  compute  the  angle  0 
-cos-1  {(u. (7)/[ u [ I r  [}  between  the  eigenvector  u 
corresponding  to  the  accurate  eigenvalue  /.  and 
the  eigenvector  r  corresponding  to  the  eigenvalue 
of  (13),  (14)  and  (15)  approximating  /..  where  (.1 
denotes  the  dot  product  between  two  vectors.  For 
the  complex  eigenvector  u~ux±ju2  and  its  ap¬ 
proximation  i-*r,  ±jv2,  we  compute  the  incli¬ 
nation  of  the  subspace  S’  —  Jr,.  fjJ  spanned  by 
the  vectors  t?,.r 2  with  respect  to  the  subspace  S 
—  {»,. u2J  spanned  by  the  vectors  u,.u-.  This 
inclination  can  be  measured  by  the  principal 
angles  0,.0,  fBjorck  and  Golub.  1973)  which  are 
defined  as  follows: 

1.  0,  is  the  smallest  angle  between  any  pair  of 
vectors  a,eS  and  bxsS\  that  is.  a,  »c,ii, 
-t-Cjiij,  b,  —  cy,  4-c*r2.  where  c,  are  scalar 
quantities. 

2.  0-  is  the  smallest  angle  between  any  pair  of 
vectors  €  S  and  b2  s  S'  subject  to  the 
constraints  u- 1  ax.  b2  A.  bx. 

The  smaller  the  angles  0,.0-  are.  the  better  the 
approximation  of  the  eigenvectors  computed 
from  the  subsystems  will  be.  This  is  because  the 
orientation  of  the  subspnees  S  and  S’  is  almost 
parallel.  From  the  definition  of  0,  and  0-.  it 
seems  that  a  search  scheme  is  required  to  find  0, 
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and  03.  However,  it  is  shown  in  Luub  (1977)  that 
cos$x,  cos 0t  are  directly  given  by  the  square 
roots  of  the  eigenvalues  of  the  2x2  matrix 
WVU  where  IT  •(VTV)~'UT,  V*  m 
tfTr)-'l  T.  (/-(>,«,].  V »£r,r J. 

For  large  systems,  comparisons  between  the 
eigenvectors  of  the  subsystem  models  with  dif¬ 
ferent  levels  of  correction  may  be  used. 
Alternatively  if  the  order  of  the  full  system  is  not 
large,  as  in  (his  case,  comparisons  between  the 
full  order  system  and  the  subsystem  models  may 
be  performed.  The  cosines  of  9,  and  0,  between 
the  accurate  eigenvectors  and  the  eigenvectors 
constructed  from  the  subsystems  are  shown  in 
Table  i.  With  first  level  correction,  the  cosine  of 
the  worst  principal  angle  is  0.815,  which  im¬ 
proves  to  0.984  with  one  more  level  of  correction. 

7.  TWO-TtM E-SCALE  SIMULATION 

From  the  validation  phase  it  can  be  expected 
that  the  7th  order  slow  subsystem  model  1 13)  and 
the  13th  order  fast  subsystem  model  (14)  with  first 
level  correction  will  provide  a  satisfactory  approxi¬ 
mation  of  the  20(h  order  modeL  The  subsystem 
models  are  used  to  simulate  a  five  cycle  three 
phase  fault  on  bus  8  followed  by  the  loss  of  line 
8-9.  The  original  state  variables  x, :  may  be 
obtained  from  the  subsystem  variables  by 
using  ( 15). 

Figures  3(a-d)  show  the  responses  of  two  slow 
variables  and  two  fast  variables  dwc, 

AV^.  Other  responses  are  similar  and  with  even 
smaller  approximation  error.  For  the  fast  vari¬ 
ables,  the  accuracy  is  excellent  as  the  difference 
between  the  exact  curves  and  the  first  level 
approximate  curves  is  virtually  indistinguishable. 
In  the  slow  variables,  the  error  is  noticeable  but 
small. 


Fig.  3(b).  7,13  decomposition  of  do,,  with  no  and  first  level 
corrections. 
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Fto.  3(c).  7,13  decomposition  of  ito,  with  no  and  first  levei 
corrections. 
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Fig.  3(a).  7.13  decomposition  of  do,  with  no  and  first  level 
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Fig.  3(d).  t.13  decomposition  of  di',,  with  no  and  firvt  level 
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Abstract.  The  notion  of  slow  coherency  is  introduced  as  a  less  demanding 
definition  of  coherency,  which  allows  for  a  lack  of  coherency  in  the  fast  part 
of  aachine  transients.  The  relationship  between  the  time  scale  properties  and 
the  slow  coherency  is  shown  to  be  the  dichotoaic  solution  of  a  aatrix  Riccati 
equation.  A  grouping  algorithm  is  presented  which  reduces  the  area 
decomposition  problea  to  one  of  obtaining  a  basis  for  the  slow  subsystea  and 
performing  a  Gaussian  elimination.  A  geoaetric  interpretation  of  this  area 
grouuing  algorithm  is  also  presented.  The  procedure  it  illustrated  with  a  3- 
aachine  and  a  16-aachine  exaaple. 
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INTRODUCTION 

The  size  of  any  present  day  power  systea  is 
such  that  full  scale  simulation  of  even  a 
basic  aultiaachine  electromechanical  model 
may  be  too  costly.  It  has  been  observed  that 
in  post- fault  transients  represented  by  this 
model  only  some  machines  closer  to  the  fault 
respond  as  individual  units,  while  other  ma¬ 
chines  more  distant  froa  the  fault  swing 
together  with  "in-phase"  slow  motion.  In  a 
typical  study,  each  of  these  groups  is  con¬ 
sidered  to  be  a  "coherent  ares".  Then,  only 
the  faulted  area  is  modeled  in  detail,  while 
other  areas  are  represented  by  equivalent 
aachines. 

A  critical  step  in  such  studies  is  the  group¬ 
ing  of  the  aachines  into  areas.  Coherent 
aachines  are  identified  either  froa  actual  or 
siaulated  aachine  responses,  (Marconato, 
Mariani  and  Saccoaano,  1973;  Podaore,  1978), 
or  by  an  algebraic  evaluation  of  the  nodes 
present  in  the  linearized  response  of  each 
machine  (Pai  and  Adgaonkar,  1979;  Lawler  and 
others,  1979;  Saccoaano,  1974a,  1974b;  DiCap- 
rio  and  Marconato.  1978;  Price  and  others, 
1978;  Bhatt,  Kwatny  and  Mablekos,  1976). 
Most  analytical  techniques  require  that  aa¬ 
chines  be  coherent  throughout  the  duration  of 
their  transients.  In  this  paper  we  introduce 
a  less  deaanding  definition  of  "slow  coher¬ 
ency,"  which  allows  a  lack  of  coherency  in 
the  fast  part  of  the  transients.  It  may  be 
interpreted  as  a  requireaent  that  the  equiv¬ 
alent  aachines  of  the  areas  represent  as 
closely  as  possible  a  preselected  group  of 
the  slowest  nodes.  The  resulting  area  decom¬ 
position  is  independent  of  various  fault 
locations . 


Wi  h  our  approach  the  slow  and  the  fast  nodes 
are  dichotoaically  separated  as  groups  using 
a  transformation  well  known  froa  the  singular 
perturbation  technique  (Chow,  Allemong  and 
Kokotovic,  1978;  Kokotovic  and  others,  1980). 
Grouping  aachines  according  to  the  slow 
coherency  criterion  acans  in  singular  pertur¬ 
bs  .on  terns  that  the  equivalent  machines 
constitute  the  slow  subsystea.  The  fast 
subsystea  is  then  formulated  to  represent  the 
fast  oscillations  within  each  area.  The  slow 
and  fast  subsystea  aodels  are  obtained  froa 
the  dichotoaic  trausforaation  matrices  L  and 
M,  which  define  a  set  of  physically  meaning¬ 
ful  state  variables.  In  the  ideal  slow 
coherency  case  the  dichotoaic  L  is  a  "group¬ 
ing"  matrix,  whose  eleaents  are  zeros  and 
ones,  and  the  state  variables  of  the  fast 
subsystea  are  machine  angle  differences 
within  areas.  On  the  other  hand,  the  aatrix 
M,  which  separates  the  slow  subsystea,  actu¬ 
ally  defines  the  slow  variables  as  the  area 
centers  of  inertias  (Stanton,  1971;  Marcona¬ 
to  ,  Mariani  and  Saccoaano  1973;  Saccoaano, 
1972) .  In  a  nonideal  cate  our  approach  is  to 
search  for  a  dichotoaic  L  whose  elements  are 
in  soar  sense  close  to  zeros  and  ones.  This 
dichotoaic  L  is  then  approximated  by  a  group¬ 
ing  aatrix  and  the  corresponding  M  is  com¬ 
puted  as  a  function  of  this  aatrix.  This 
results  in  areas  which  contain  aachines  that 
are  near-coherent  in  their  slow  modes,  and  in 
weakly  coupled  rather  than  decoupled  slow  and 
fast  subtysteas. 

In  the  literature  on  power  systea  dynamic 
equivalents,  there  has  been  a  continuing 
interest  in  the  developaent  of  a  systematic 
area  decoaposition  procedure.  Our  grouping 
algorltha  reduces  the  decoaposition  procedure 


to  the  calculation  of  a  baaia  for  tha  alow 
subsyataa  and  a  Gauaaian  elimination.  In  tha 
formulation  of  our  algorithm  we  have  bane* 
fited  froa  insights  and  results  of  the  above 
referenced  authors.  In  particular,  a  motiva¬ 
tion  to  relate  coherency  and  singular  pertur- 
bations  is  found  in  OiCaprio  and  Marconato 
(1978)  and  some  important  properties  of  what 
we  call  r-deco*posable  systeas  appear  or  are 
alluded  to  in  Saccoaano  (1974a).  Our  analy¬ 
sis  incorporates  these  properties  in  a 
unified  fraaework  of  dichotomic  solutions  of 
Riccati  equations  and  establishes  new  proper¬ 
ties.  These  properties  are  the  tools  for  the 
development  of  the  algoritha  and  the  aepara- 
tion  of  time  scales. 

In  the  nest  section  we  first  review  soae 
properties  of  the  aodel  used  in  this  paper. 
The  third  section  defines  the  notion  of  slow 
coherency  and  reveals  the  structure  of  ideal- 
ly  decomposable  system a.  A  grouping  algo¬ 
ritha  is  developed  for  near-decoaposable 
systeas  in  the  fourth  section.  The  fifth 
section  introduces  the  slow  variables.  While 
the  original  states  contain  a  aix  of  fast  and 
slow  phenomena,  the  new  states  aake  it  pos¬ 
sible  to  apply  singular  perturbation  tech¬ 
niques  to  nonlinear  electroawchanical  and 
potentially  more  extensive  power  system 
models.  The  presentation  in  the  fourth  and 
fifth  sections  is  illustrated  by  a  16-machine 
example. 

ELECTROMECHANICAL  MODEL 

The  well-known  electromechanical  aodel  (An¬ 
derson  and  Fouad,  1977)  of  an  n-aachine  power 
system  is 

a .  «  iKuij  -  i) ,  (2.i) 

ZH.iir  a  -D.(ui.-l)  +  (PBi*Pei),  (2.2) 
where 

i  3  1.  2,  ...,*h, 

at  a  rotor  angle  of  machine  i  (radians), 

uii  a  speed  of  machine  i  (per  unit), 

P ,*  mechanical  input  power  of  machine  i  (per 
unit) , 

P  .»  electrical  output  power  of  machine  i 
(per  unit), 

a  inertia  constant  of  machine  i  (seconds), 

D.  a  damping  constant  of  machine  i  (per 
1  unit), 

0  a  base  frequency  (radians  per  second). 

In  this  aodel  disturbances  are  represented  by 
appropriate  selection  of  initial  conditions, 
and  the  following  assumptions  are  usually 

made. 

(Al)  Mechanical  input  power  P  .  is  constant. 
(A2)  The  electrical  output  poSIr  is 


p«*  *  ji  vivj  via(vv^cii* 

JPi 

i  *  l:  2 . n.  (2.3) 

where  the  per  unit  voltage  V.  behind  tran¬ 
sient  reactance  is  assumed  to  Be  constant  and 
aaliency  is  neglected.  Loads  are  represented 
by  passive  impedances,  and  G  and  B  are  the 
real  and  imaginary  parts  of  the  reduced 
admittance  matrix  T  at  the  internal  machine 
nodes.  The  off-diagonal  resistive  terns  of  T 
are  neglected. 

The  intermachine  motiona  are  largely  deter¬ 
mined  by  the  natural  frequencies  and  the  mode 
shapes  of  the  linearised  electromechanical 
model  around  the  stable  equilibrium  fl*  and 
m  l.o.  the  linearized  model  is  1 


Ad^  m  Oku., 

(2.4) 

n 

2H  Ail.  *  -D  Aw  -  I  k  Ad., 

11  j3l  J 

(2.5) 

where 

Ad.  »  5.  -  6*. 
i  i  i 

(2.6) 

Au»i  rn  W.  -  1, 

(2.7) 

a  1 

ku  *  ji  viYijc#,(VVk 

(2.8) 

kij  *  VjV^VVld*  • j,,i- 

(2.9) 

At  6*  and  w*,  the  eigenvalues  of  (2.4)  and 
(2.5)  are  of  the  following  three  types: 

1.  a  zero  eigenvalue  corresponding  to  the 
motion  of  all  the  machine  angles, 

2.  a  small  negative  real  eigenvalue  corre¬ 
sponding  to  the  aggregate  speed  of  all 
the  machines,  and 

3.  (n-1)  pairs  of  lightly  dashed  oscilla¬ 
tory  modes  which  typically  range  in 
frequency  from  1/2  to  2  Hz. 

Models  involving  more  details  such  as  excita¬ 
tion  systems  and  governors  would  still  con- 

r.JI'fn  fl»#  JlhrtV#  set  rtf  m*%A4fimA 

aostly  in  the  d taping  end  not  in  the  frequen* 
cies  (Podmore,  1978).  Since  the  small 
damping  constants  D.  do  not  significantly 
affect  the  frequencies  of  the  oscillatory 
modes  (DiCaprio  and  Sccomano,  1970)  they  may 
be  neglected.  Thus,  the  model  used  in  this 
paper  is 

x  =  -(l/2)(W*lK  x  $  Ax,  (2.10) 

where 

x .  *  A6 . 

i  i 

H  *  diag  (Hr  H2 . Ha) 

K  »  (k.j).  (2.11) 
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Therefore  instead  of  dealing  with  a  systea  of 
order  2n,  we  only  need  to  deal  with  the  nxa 
matrix  A.  Due  to  Assuaption  (A2),  K  ia 
symmetric  if  Y  ia  ayMMtric  which  ia  true  for 
networks  without  phase  shifters. 

The  properties  of  the  eigenvalues  of  the  A 
aatrix  are  as  follows: 

(PI)  A  has  a  zero  eigenvalue  whose  eigenvec¬ 
tor  is 

v  a  (  in  ...  i  )•  (2.12) 

o 

Property  (PI)  follows  froa  Av  *0,  which  ia 
due  to  (2.8)  and  (2.9)  as  the  sun  of  each  raw 
in  ^(‘jj )  i» 

n 

l  a.,  a  0  i  a  1,  2,  ....  a  (2.13) 

j=l  lJ 

(P2)  When  K  is  syaaetric  A  is  diagonalizable 
because  it  is  siailar  to  the  syaaetric  aatrix 

-(1/2)QH*1/2EH‘1/2 

1/2 

where  H  is  the  square  root  of  H. 

Thus,  all  the  eigenvalues  A.  of  A  are  real. 
It  follows  that  the  eigenvalues  of  the  second 
order  systea  (2.10)  are  +<r  ,  where 

on  a  ^  (2.14) 

For  A.  negative,  they  are  on  the  imaginary 
axis  close  to  the  slightly  daaped  eigenvalues 
of  (2.4)  and  (2.5).  The  double  eigenvalue 
a.ao  corresponds  to  the  aggregate  notion  of 
tie  aachine  angles  and  speeds.  In  the 
following  analysis,  it  is  important  to  note 
that  the  low  frequency  nodes  of  (2.4)  and 
(2.5)  are  the  slow  nodes  of  A. 

SLOW  COHERENCY 

In  aost  actual  and  siauilated  responses  the 
groups  of  aachines  "swinging  together”  are 
discernible  only  in  slow  notion.  This  noti- 
vates  the  following  definition  of  coherency 
which  allows  responses  of  coherent  aachines 
to  have  different  fast  dynsaics. 

Definition  3.1 

Given  r  saallest  in  aagnitude  eigenvalues 
(slowest  nodes)  of  A  in  (2.10).  Then  aa¬ 
chines  "i"  and  "j"  are  slowly  coherent  if  for 
all  t  of  interest,  possibly  te{0,»),  their 
angles  x^t)  and  Xj(t)  satisfy 

xi(t)  -  x^(t)  =  (3.1) 

where  z .  .  ( t )  contains  none  of  the  r  slow 
nodes.  V  coherent  area  consists  of  all  the 
aachines  coherent  to  each  other. 

This  definition  of  coherency  nay  be  inter¬ 
preted  as  a  cow  property  of  the  nxr  matrix  V 
of  slow  eigenvectors.  Machines  i  and  j  are 
coherent  if  rows  i  and  j  of  V  are  identical. 
It  is  not  hard  to  tee  that  this  reaains  true 
for  the  coluams  of  V  that  fora  any  basis  of 
the  slow  eigensubspace. 


We  note  that  in  this  definition  no  aachines 
froa  different  areas  can  be  coherent,  that  is 
no  coherent  area  can  be  divided  into  aore 
areas.  An  individual  aachine  can  constitute 
an  area  if  it  is  not  coherent  with  any  other 
aachine. 

Although  Definition  3.1  does  not  require  that 
the  number  of  coherent  areas  be  equal  to  the 
nuaber  of  slow  aodes,  systeas  with  this 
property,  which  will  be  called  r-decoapoaable 
systeas.  are  of  particular  interest  for 
separation  of  tine  scales.  The  study  of  r- 
decoaq>osable  systeas  is  an  essential  step 
toward  the  analysis  of  aore  coaaoo  "near- 
decoaposable”  systeas,  that  it  systeas  with 
near-coherent  rather  than  coherent  areas. 

Definition  3.2 

The  aachines  "i”  and  "j”  are  near-coherent  if 
in  Definition  3.1  the  contribution  of  the 
slow  aodes  in  z.. (t)  la  small.  A  near- 
coherent  area  consists  of  all  aachines  which 
are  near-coherent  to  each  other.  An  r  near- 
decoaposable  systea  consists  of  r  near- 
coherent  areas. 

Our  approach  to  area  determination  is  to 
first  consider  r-decomposable  systeas.  We 
show  that  ia  this  idealized  case  the  dicho¬ 
tomic  solution  of  a  matrix  Riccati  equation 
autoaatically  groups  the  machines  into  areas. 
We  then  use  this  result  to  develop  a  grouping 
algoritha  for  near-decomposable  systeas. 

To  define  a  compact  notation  for  areas  we 
introduce  a  reference  set  of  aachines  and  a 
iroupint  aatrix.  In  each  area  we  pick  an 
arbitrary  aachine  as  the  reference  machine. 
The  reference  machine  angles  ace  considered 
as  components  of  an  r-vector  x  ,  while  all 
other  angles  form  the  (n-r)-vector  x. 
Equation  (3.1)  motivates  the  use  of  a  group¬ 
ing  aatrix  L  to  assign  machines  to  areas. 
The  (i,j)  entry  of  L  is  1  if  aachines  x. 
and  xf  are  in  the  sine  area,  and  is  zeri 

otherwise.  Thus,  given  x1,  x4  and  L  the 
areas  are  uniquely  determined.  Ho&ver, 
given  the, areas  there  is  no  unique  choice  of 
x1  and  x4,  and  hence  aany  possible  choices 
for  L_  exist. 

8 

As  an  illustration  consider  a  three  area 
five-aachine  system.  Given 

X  ”  (x^,  Xj,  1^) 

*2  *  (Xj,  Xj)’  (3.1) 

fl  0  ol 


the  three  areas,  which  are  coaposed  of  ma¬ 
chines  1  and  3,  machines  2  and  5  and  machine 
4,  are  uniquely  define^.  Foe  the  same  areas 
a  different  choice  of  xl  and  x  ,  such  as 

x1  =  (x4,  Xj,  x2)' 

x2  *  (Xj,  Xj)’ 


(3.3) 


(3.12) 


will  result  ia  a  different  L  ,  that  ia 


0  1  o' 

Lt  * 

*  |_0  0  1 


(3.4) 


Note  that  the  zero  column  in  L  of  (3.2)  or 
(3.4)  indicates  the  preaence  *of  a  single 
machine  area. 


Using  L  ,  (3.1)  is  rewritten  sore  compactly 
as  * 


x2(t)  -  L§*l(t) 


*2(t) 


(3.5) 


where  the  components  of  z4(t)  are  the  corre¬ 
sponding  functions  z..(t).  In  the  case  where 
an  area  contains  k14achines  Jthere  will  be 
exactly  (k-1)  elements  in  z4(t)  for  this 


area. 


He  interpret  (3.5)  as  a  special  caae  of  a 
■ore  general  coordinate  transformation 
(Kokotovic  and  others,  1980) 
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where 
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B1  *  *11  +  *12L 


B2  *  *22  *  U12 


R(t)  *  Ajjl.  -  LA1X  -  UUL  ♦  A. 
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(3.8) 

(3.9) 


Ld-1, 


Proof:  If  the 


system  is  r- decomposable,  then 
for  the  given  x  and  x  a  grouping  matrix  L_ 


exists  such  that  (3.5)  it  satisfied  an8 
z4contains  no  slow  modes.  Substituting  L*L 
into  (3.7)  through  (3.11)  we  can  shtut  thaf 
(3.10)  and  (3.11)  must  hold  or  else  z4  would 
contain  slow  nodes .  This  is  clear  from 


Bi  *ii][wl,  K 
R(t)  B2  J  [_oJ  _0_ 


(3.13) 


where  the  (n-r)  x  r  matrix  L  ia  not  necessar¬ 
ily  a  grouping  matrix.  The  substitution  of 
(3.5)  into  (2.10),  that  is  into  ic*Ax,  results 
in 


where  A  is  the  diagonal  SMtrix  of  the  r  slow 
eigenvalues  and  the  rows  of  [W'O1  ]  are  the 
corresponding  eigenvectors  in  the  (x  , 
z4)-coordinates.  Hence  R(L)Wno,  which  im¬ 
plies  R(L)*0.  Then  x£*B,x*  and  (3.11)  must 
also  hold.  This  proves  xhe  if  part  of  the 
theorem,  because  I.  is  unique.  Conversely, 
if  an  L.  exists  and  is  a  grouping  matrix, 
then  thesystem  ia  r-decomposable  because  L 
satisfies  (3.10)  and  (3.11).  B 


An  interesting  interpretation  of  R(L  )*0  is 
a  set  of  slow  coherency  conditions  satisfied 
by  the  voltages,  admittances,  machine  angles 
and  inertias  of  an  r-decomposable  system. 
Let  a(i)  be  the  set  of  machines  belonging  to 
area  i.  Then  using  the  structure  of  L  and 
R(L  )*0  we  may  conclude  that  * 


51  J  9  B  cos (6  -6  )  * 
r  mea(i)  01  r  “ 


V. 


H1  1  V_®«.»*(V«J  (3.U) 


w  •  '.wo  IV  . 

“j  mea(i)  "  J  J 
for  all  i,  k*l,  2,  ...,  r,  i/k 


and  Aj. ,  *12,  A21,  A,  arejthe  submatrices  of 
A  conformal4  with  x  end  x4.  We  are  particu¬ 
larly  interested  in  L  which  satisfies 

R(L)  «  AjjL-Uy-UjjWjj  *  0  (3.10) 

and 

lyM  <  l*i(#2)|  (3,u) 

for  all  i«l,2, . . . ,n-r  and  jml,2,...,r.  Such 
an  L  is  called  dichotomic  and  denoted  by  L, . 
It  is  known  from  Wu  (1977),  Hartenason 
(1971),  Avramovic  (1979),  and  Hedanic  (1979), 
that  for  diagonaliaable  A  the  generalized 
Riccati  equation  (3.10)  can  have  at  most  one 
dichotomic  solution  L*L ..  The  following 
property  of  an  r-decomposable  system  relates 

L.  to  a  grouping  matrix  L  . 

d  g 

Theorem  3.1 

In  an  n-machine  system  let  x*  be  the  angles 
of  r  oon-coherent  machines  and  x4  be  the 
angles  of  the  other  n-r  machines.  This 
system  Is  r-decomposable  if  and  only  if  the 
dichotomic  solution  l«l.  of  the  corresponding 
equation  R(L)*0  is  a  grouping  matrix  L  ,  that 
is  if  and  only  if  * 


where  r  is  the  reference  machine  in  area  k 
and  j  is  any  machine  in  area  k.  In  other 
words,  the  sum  of  the  interconnections  be¬ 
tween  the  reference  machine  r  in  area  k  and 
all  the  machines  in  area  i  is  the  same  aa  the 
sum  of  the  interconnections  between  any 
machine  j  in  area  k  and  all  the  machines  in 
area  i.  These  conditions  hold  for  all 
areas.  Such  "tuned”  conditions  will  general¬ 
ly  not  hold  in  practical  situations.  How¬ 
ever,  in  prsctice,  for  relatively  normal 
conditions,  voltages  are  close  to  1.0  p.u. 
and  the  cosines  in  (3.14)  are  close  to  1.0. 
Thus,  the  coherency  condition  (3.14)  is 
primarily  determined  by  machine  inertias  and 
line  admittances,  that  is  by  network  con¬ 
figuration  and  much  less  by  the  operating 
conditions.  A  quantitative  criterion  for 
interpreting  deviations  from  the  conditions 
in  (3.14)  requires  further  investigation  and 
is  beyond  the  scope  of  this  paper. 

Suppose  now  that  we  know  that  a  system  is 
r-decomposable,  but  we  do  not  know  its 
areas.  How  can  Theorem  3.1  help  ua  to  find 
them?  First,  we  make  a  choice  of  x1  and  x  , 
which  in  turn  defines  the  corresponding 
equation  R(L)s0.  If  our  choice  of  x1  does 
not  contain  coherent  machines  this  equatioa 


will  have  Che  dichotomic  solution  L.  which  is 
the  grouping  matrix  needed  to  find  the  areas. 
If  our  x1  contains  coherent  machines,  L.  will 
not  exist.  The  negative  outcome  would  mean 
that  a  new  choice  of  x1  would  have  to  be  made 
and  a  new  equation  R(l)=0  solved. 

If  the  system  is  not  r-decomposable ,  then  no 


grouping  tutrix  L  will  satisfy  R(L  )*0. 
Therefore  in  (3.%)  will  contain  both°fast 
and  slow  nodes,  that  is 

z2  =  z2+z2  (3. IS) 

For  near  decompose blej  systems  there  exist  x1 
and  L  such  that  z  is  snail.  Rewriting 
(3.5)  for  the  slow  parts 

*s*  (3-16) 

We  now  have  the  problem  of  finding  x''  and  L 
such  that  some  measure  of  the  slow  coherencf 
error  z^  is  minimized.  From  (3.6)  with  L=L, 
it  follows  that  “ 

\  ^  3  °-  (3.17) 

Substituting  (3.17)  into  (3. IS)  we  obtain 

z\  =  (1Ld  '  V  *»  «.1S) 

An  important  conclusion  is  that  the  slow 
coherency  error  z*^  relative  to  the  magni¬ 
tude  x*  of  the  s*low  response  of  the  refer¬ 
ence  machines  is  bounded  by  ||Ld-I,  |  ,  that 


H(ssc)=6.4 

D(pu)=2.5 
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Fig.  3.1.  Three  Machine  Test  Systa 
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where  the  norm  it 


|L  ]  *  max  I  |L  |  ,  i=l . n  (3.20) 

i  j=>l  J 

Note  that  (3.19)  is  zero  for  r-deconposable 
systems.  For  near-decomposable ^  systems 
(3.19)  motivates  a  search  for  xx  and  L 
yielding  the  smallest  |L,-L  |  .  In  principle 
this  search  involves  tne  comparison  of  all 
possible  grouping  matrices  L  with  the 

dichotomic  solutions  L .  correspcAdlng  to  til 
possible  choices  of  reference  machines  x  . 
However  a  much  simpler  grouping  algorithm 
based  on  properties  of  L,  is  given  in  the 
next  section. 

To  motivate  the  grouping  algorithm  and  te 
illustrate  the  use  of  (3.19)  we  consider  in 
detail  the  three  machine  system  given  in 
(Figure  3.1).  For  the  given  numerical  values 
the  undamping  linearized  model  is 

..  pi*.  3  5.5  8.8] 

x  =  14.3  -49.4  35.1  x.  (3.21) 

l_58.5  81.5  -140. Qj 

To  decompose  the  system  into  two  areas,  there 
are  only  three  possible  choices jOf  reference 
machines  for  thu  example,  x  -  (x.,x,)', 

x'*(x,,x.)'  and  x^lx-.x,)’  and  two  possible 
choices  of  L  *[0,1]  and  il,0].  As  our  first 
choice  of  reference  machines  consider  x‘  * 
(x.,x.)'.  Then  the  dichotomic  solution  of 
the  corresponding  equation  R(L)*0  is 


ld  *  [-0.470  1.47).  (3.22) 

Of  the  two  possible  grouping  matrics  L  *[0  1] 
yields  the  minimum  8 

I  VLg  I  =  °-94-  »•»> 

The  second  choice  of  x3=(x,,x.)'  will  result 
in  a  dichotomic  solution  orthi  corresponding 
equation  R(L)=0 


Ld  *  [-2.13  3.13).  (3.24) 

Of  the  two  possible  grouping  suitrics  L  =[0  1] 
yields  the  minimum  jLj-Lgft  * 

lvigl  3  4-26-  (3-25) 

The  third  possible  choice  of  x1=(x.,x,)' 
will  result  in  a  dichotomic  solution  of  Che 
corresponding  equation  R(L)*0 

Ld  *  [0.320  0.680].  (3.26) 

Of  the  two  possible  grouping  matrics  L  =[0  1] 
yields  the  minimum  |Ld~Lg|  * 

lvLg  I =  °-64-  (3-27) 

Of  these  three  cases,  l.  of  (3.26)  yields  the 
smallest  |  L.-L  |  .  For  this  case,  L  ,  xl, 
ar  ■*  xz  indicate  that  machine  1  is  in  on  area 
and  machines  2  and  3  fora  the  other  area. 


.  r 


This  example  shows  that  it  is  possible  to 
hsvo  wore  than  one  element  in  D  which  results 
in  the  sene  sres  groupies  as  is  the  case  with 
the  first  and  third  choices  of  reference 
Machines.  However,  the  grouping  is  most 
clearly  shown  by  the  third  choice.  It  is 
also  interesting  that  for  the  third  choice 
|L.J  is  the  SMllest  of  all  three.  The 
second  choice  has  the  largest  |L.-L  8  and  the 
reference  Machines  are  fron  the  nae  area. 
Another  interesting  observation  about  L.  ia 
that  the  sum  of  row  eleaents  in  all  three 
cases  is  1. 

Due  to  R(L  )  not  being  equal  to  aero,  the 
eigenvalues *of  B,  and  B,  will  not  be  equal  to 
those  of  A.  However,  the  eigenvalues  of  B, 
and  Bj  are  close  to  those  of  A  1 

A1(B1)«0.0,  A2CB1)*-28.6,  X1(B2)*-175.0 

X1(A)*0.0,  X2(A)*-37.0,  X3(A)«-16«.0 

which  can  be  used  as  an  indication  that  the 
areas  arc  near-coherent. 

The  above  direct  search  is  presented  only  as 
a  Motivation  for  the  systenatic  grouping 
algoritha  proposed  in  the  next  section. 

GROUPING  ALGORITHM 

From  the  three  Machine  example  it  is  apparent 
that  finding  the  areas  consists  of  two 
interdependent  tasks:  first,  choosing  the 
reference  Machines  and,  second,  associating 
the  other  machines  to  the  reference  Machines. 
The  approach  used  in  the  three  Machine  examr 
pie  is  to  exhaust  all  possible  choices  of  x1 
and  L  ,  that  is  for  each  L.,  a  particular  L 
was  Pound  fo  minimize  Jl^-L  I  .  The  besl 
choice  of  x*  is  the  one  corresponding  to  the 
smallest  of  these  minisu.  When  the  order  of 
the  systen  is  Large,  this  exhaustive  search 
would  be  computationally  prohibitive.  Due  to 
the  properties  of  the  set  D  established  in 
Lemmas  4.1  and  4.2,  the  exhaustive  search  can 
be  avoided.  The  algorithm  presented  in  this 
section  computes  only  one  element  of  the  set 
D,  which  does  not  necessarily  minimize  |  L 
1  |  >  but  still  unambigously  determines  tBe 
areas.  We  also  provide  a  geometric  interpre¬ 
tation  for  this  algorithm. 


Every  element  L^  of  D  has  the  property  that 

%  * 1  •  isi>2’-  f*-1) 

that  is,  the  row  sum  of  Lj  is  1. 

The  proof  of  lemma  4.1  is  given  in  the 
Appendix.  From  (4.1),  if  all  the  entries  of 
Lj  are  greater  than  or  equal  to  zero,  then 
fM  **  1.  «hich  i*  the  smallest  norm 

achievable  by  any  Lj  in  0.  Furthermore, 


since  the  only  nonzero  entry  in  any  row  of  L 
is  1 ,  any  grouping  matrix  L  has  row  norf 
equal  to  1.  Thus,  to  minimize  Jl.-lJ  ,  a 
necessary  condition  is  that  |L,|  be0 close  to 
1.  This  motivates  finding  an  Ir.  with  a  small 
norm  instead  of  an  l.  which  minimizes  I L  .- 
1,1 

The  following  result  indicates  how  |  L*  1 
depends  on  choice  of  reference  machines. 


Let  the  angles  of  a  given  set  of  reference 
machines  be  ordered  as  components 2of  x1  and 
all  the  other  machine  angles  as  x  ,  and  let 
the  columns  of  the  nxr  matrix 


where  the  rxr  matrix  V  is  nonsingular,  be  a 
basis  of  the  eigensubspace  of  the  slow 
modes .  Then 


is  the  unique  dichotomic  solution  of  the 
Riccati  equation  (3.10).  Furthermore,  let 
V.  and  be  obtained  by  exchanging  rows  of 
V,  for  rnn  of  V.,  that  is  by  a  permutation 
V*PV  of  the  rows'4  of  V.  Provided  that  is 
nonsingular,  the  element  of  D  corresponding 
to  x*Px  is  Ld=V2V^  . 

The  proof  of  Lemma  4.2  is  given  in  the 
Appendix.  This  lemma  establishes  the  con¬ 
nection  between  the  Riccati  approach  pre¬ 
sented  here  with  the  modal  approach  given  in 
Saccomano  (1974a).  The  lemma  shows  that  to 
compute  all  the  elements  in  D,  we  only 
need  to  compute  one  V.  Furthermore,  multi¬ 
plying  both  sides  of  (4.2)  by  we  see  that 


LLdJ 


is  also  a  basis  for  the  eigenspace  of  the 
slow  modes.  In  the  r-decomposable  case,  V. 
will  be  singular  if  two  machines  from  the 
saae  area  are  in  x  .  In  the  near-decompos¬ 
able  systems  V.  will  be  close  to  singular  if 
two  near-coherent  machines  are  in  x.  This 
is  due  to  the  fact  that  the  two  rows  involved 
are  almost  identical .  When  V.  is  close  to 
singular  || V . is  large,  resulting  in  a  large 
L..  Thus  we  aim  at  finding  r  large  and  most 
linearly  independent  rows  of  V.  This  would 
result  in  a  V  with  a  large  norm  such  that 
jjLglJ  of  (4.3)  would  be  small. 

To  find  this  set  of  r  rows,  we  use  Gaussian 
elimination  with  complete  pivoting.  During 
the  elimination,  the  rows  and  columns  of  V 
are  permuted  such  that  the  (1,1)  entry  of  the 
resulting  V  is  the  largest  entry  in  magni¬ 
tude.  Note  that  permuting  the  rows  of  V  is 


v 


equivalent  to  changing  the  ordering  of  the 
aachinet-  This  (1,1)  entry  of  V  is  used  as 
the  pivot  for  performing  the  first  step  of 
the  Gaussian  eliaination.  Then  the  largest 
entry  is  chosen  from  the  resuining  (n-l)x(r- 
1)  subaatrix  of  the  reduced  V  and  is  used  as 
the  pivot  for  the  next  eliaination  step.  The 
eliaination  terminates  in  r  steps  and  the 
machines  corresponding  to  the  first  r  rows  of 
the  final  reduced  V  matrix  are  designated  as 
the  reference  aachines.  In  this  Gaussian 
eliaination  process,  rows  having  small  en¬ 
tries  will  not  be  uaed  as  the  pivoting  row 
because  these  small  entries  are  the  result  of 
eliaination  with  almost  identical  rows  al¬ 
ready  uaed  as  pivoting  rows.  Thus,  this 
algorithm  does  not  put  two  near-coherent 
aachines  together  as  reference  aachines . 

For  the  set  of  reference  aachines  found  by 
the  algorithm  the  corresponding  L ,  is  readily 
coaiputed  from 

=  V-  (4.5) 

using  the  LU  decomposition  of  V.  obtained 
froa  the  Gaussian  eliaination.  The1  next  step 
is  to  find  an  L  approximating  L.,  that  is  to 
find  the  machines  belonging  to  each  area.  We 
exaaine  each  row  of  L.  and  if  the  largest 
positive  entry  is  the  J-th  entry  in  the  row 
i,  then  in  the  matrix  L  entry  (i,j)  is  1. 
The  resulting  will  yi#ld  the  minimum  j  L^- 

We  now  summarize  the  grouping  algorithm  as 
follows: 


Step  1:  Decide  on  the  nuaber  of  areas. 

Step  2:  Compute  a  basis  matrix  V  for  a 
given  ordering  of  the  x  variables. 

Step  3:  Apply  Gaussian  eliaination  with 
complete  pivoting  to  V  and  obtain 
the  set  of  reference  machines. 

Step  4:  Compute  Lj  for  the  set  of  reference 

aachines  chosen  in  step  3.  Con¬ 
struct  the  aatrix  l  and  find  the 
aachines  in  each  area. 


Step  4: 


The  main  computational  load  is  in  the  step  2. 
However,  only  a  partial  eigensubspace  V  of  A 
is  required  and  since  A  is  similar  to  a 
symmetric  autrix,  eigenvalue-eigenvector 
computation  ia  well  conditioned  (Vilkenaon 
and  Reinsch,  1971).  Alternatively  we  can 
make  an  initial  guess  of  the  set  of  reference 
machines  and  apply  the  Riccati  iterative 
algorithm  in  Kokotovic  (1975)  to  calculate 
If  the  solution  converges,  then  the 
resulting  L.  can  be  used  to  construct  the 
basis  (4.4). 

This  area  grouping  algorithm  which  finds  L. 
of  small  norm  is  supported  by  the  geometric 
interpretation  of  near-decomposable  systems. 
For  such  systems,  the  row  vectors  of  V  cor¬ 
responding  to  machines  in  the  same  area  are 
almost  identical.  In  other  words,  the  row 
vectors  of  machines  belonging  to  the  same 
area  are  clustered  in  a  cone.  These  cones 
are  narrow  for  nesr-decoaposable  systems  and 
degenerate  to  lines  for  r-decoaposable  sys¬ 
tems.  The  role  of  Gaussian  elimination  is  to 
select  the  most  linearly  independent  vectors, 
one  from  each  cone,  which  are  then  considered 
as  the  reference  vectors  for  the  areas.  The 
entries  in  L,  are  the  projections  of  other 
vectors  on  tlie  reference  vectors.  Therefore, 
it  is  easy  to  see  that  in  each  row  of  L.  the 
entry  close  to  1  corresponds  to  the  projec¬ 
tion  of  the  vector  on  the  corresponding 
reference  vector,  and  the  entries  close  to 
zero  are  projections  of  the  vector  to  the 
other  reference  vectors. 

He  illustrate  this  area  selection  procedure 
on  a  16  machine  model  (Figure  4.1)  in  Schulz 
and  others  (1974).  The  data  are  given  in  the 
reference  and  hence  will  not  be  repeated 
here.  The  model  is  linearized  and  the  damp¬ 
ing  is  neglected  to  obtain  the  A  matrix  in 
(2.10).  In  the  first  step  of  the  algorithm 
we  specify  that  we  want  5  areas,  that  is  r*5. 
Froa  this  point  on  the  algorithm  proceeds 
automatically  giving  the  following  results. 
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ABSTRACT 

The  slow  coherency  concept  is  introduced  and  an 
algorithm  is  developed  for  grouping  machines  having 
identical  slow  motions  into  areas.  The  singular 
perturbation  method  is  used  to  separate  the  slow 
variables  which  are  the  area  center  of  inertia  vari¬ 
ables  and  the  fast  variables  which  describe  the  inter- 
machine  oscillations  within  the  areas.  The  areas 
obtained  by  this  method  are  independent  of  fault 
locations.  Three  types  of  simulation  approximations 
illustrated  on  a  nonlinear  48  machine  system  indicate 
the  validity  of  this  algorithm. 

1 .  INTRODUCTION 


This  paper  presents  a  systematic  procedure  for 
grouping  the  machines  of  a  power  system  into  areas. 
The  concept  of  an  area  is  based  upon  the  observation 
that  in  postfault  transients  only  some  machines  close 
to  the  fault  location  respond  with  fast  intermachine 
oscillations,  while  other  machines  more  distant  from 
the  fault  swing  together  in  groups  with  "in  phase" 
slow  motion.  Our  approach  is  to  define  areas  by 
grouping  the  machines  which  exhibit  this  slow  co¬ 
herency  phenomenon.  Allowing  the  machines  in  the  same 
area  to  differ  in  their  fast  dynamics  makes  it  possi¬ 
ble  to  retain  the  same  area  grouping  for  different 
fault  locations.  The  resulting  conceptual  simplifi¬ 
cations  and  computational  savings  ate  significant  in 
simulation  and  planning  studies  when  many  contin¬ 
gencies  need  to  be  examined. 


The  notion  of  slow  coherency  is  expressed  in  the 
following  way.  If  we  consider  the  r  slowest  modes  of 
the  system's  response  to  any  fault,  then  machines  "i” 
and  "j"  are  slowly  coherent  if  the  difference  of  their 
angles  x  .  ( t )  and  ( t ) 

ijU)  -  Xjlt)  =  z^(t)  (1.1) 


contains  none  of  the  r  slowest  modes.  This  definition 
disregards  differences  of  the  fast  dynamics  of  ma¬ 
chines  within  the  same  area.  In  contrast  to  the 


more  conventional  definitions  of  coherency  (1-6], 
which  require  that  the  total  angular  difference  z.  (t) 
be  within  a  specified  tolerance,  here  the  toleranci  is 
specified  only  for  the  slow  modes  in  z . . (t) . 
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Our  approach  to  grouping  machines  starts  with  the 
linearized  electromechanical  model  without  dashing, 
and  separates  its  slow  and  fast  modes  using  the  so 
called  dichotomic  transformation  from  the  singular 
perturbation  technique  |7],  The  dichotomic  transfo-- 
mation  matrices  L  and  M  define  a  set  of  physically 
meaningful  state  variables.  In  the  ideal  slow  coher¬ 
ency  case  the  dichotomic  L  is  a  "grouping"  matrix, 
whose  elements  are  zeros  and  ones,  and  the  state 
variables  of  the  fast  subsystem  are  machine  angle 
differences  within  areas.  On  the  other  hand,  the 
matrix  M,  which  separates  the  slow  subsystem,  defines 
the  slow  variables  as  the  area  centers  of  inertias 
(1,2,4).  In  a  nonideal  case  we  search  for  a  dicho¬ 
tomic  L  whose  elements  are  close  to  zeros  and  ones. 
This  results  in  areas  which  contain  machines  that  are 
near-coherent  in  their  slow  modes. 

The  slow  interarea  dynamics  and  the  fast  mtra 
area  dynamics  are  suitable  for  two  time  scale  analysis 
of  power  systems  by  the  singular  perturbation  method. 
This  method  is  applicable  to  systems  in  the  so  called 
state  separable  form 

jjj  =  fU.n.t)  ,  4<to)  =C°  (i.2) 

£  H  =  g(5,n,t)  ,  nU0)  =  n°  0.3) 

where  4  and  n  represent  the  "slow"  states  and  rhe 
"fast"  states  of  the  system  respectively ,  and  t  is  a 
small  positive  parameter  which  accounts  for  small  time 
constants,  inverses  of  high  gain  coefficients,  small 
inertias,  etc.  If  the  separation  between  time  scales 
in  (1.2)  and  (1.3)  is  'arge,  e  will  be  small  and  may 
be  approximated  by  e=0.  The  model  (12)  and  (1.3) 
with  e~0  then  defines  the  quasi-steady-state  £.  (t), 
nsU)  as  s 

<*.(0 

-5T- •  f(t,.  V  t)  .  W  -  6° 

0  =  8(is.  V  t)  (1.5) 

where  the  differential  equations  for  n  have  been 
reduced  to  algebraic  or  transcendental  equations. 

In  (1.2),  (1.3)  t  .e  variables  £  are  predominantly 
slow,  that  is,  £(t)  =  4s(t),  while  the  variables  Hit) 
contain  a  significant  fast  component  nit)  -  n  it) 
which  becomes  infinitely  fast  as  C-0.  For  application 
of  the  singular  perturbation  method  it  is  necessary  to 
express  the  system  dynamics  in  the  form  (1.2)  (1.3). 

System  models  which  describe  fast  and  slow  phe¬ 
nomena  do  not  always  appear  in  this  form.  For  exam¬ 
ple,  the  electromechanical  model  using  individual 
machine  speeds  and  angles  as  the  state  variables  does 
not  exhibit  this  slow-fast  separation.  A  new  set  of 
state  variables  which  brings  the  model  to  the  form 
(1.2),  (1.3)  are  the  interarga  motions  which  represent 
the  "slow”  states  £,  and  intra  area  motions  of  the 
machines  within  an  area  which  represent  the  "fast" 
states  n  in  (1.2),  (1.3). 
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The  procedure  presented  in  the  first  pert  of  this 
paper  transforms  the  conventional  nonlinear  electro¬ 
mechanical  model  into  the  form  (1.2),  (1.3)  by  app¬ 
lying  the  area  grouping  obtained  in  the  study  of  the 
linearized  model.  In  the  second  part  of  the  paper  we 
demonstrate  some  properties  of  the  transformed  non¬ 
linear  models  which  are  useful  in  understanding  inter¬ 
area  motions  and  model  simplifications.  When  only  the 
area  motions  are  of  interest,  all  the  dynamic  equa¬ 
tions  for  the  intra  area  fast  variables  are  reduced  to 
equations  (1.5)  regardless  of  the  fault  location.  A 
property  observed  in  the  example,  which  results  in  a 
different  approximation,  is  that  the  fast  phenomena 
from  different  areas  are  weakly  coupled,  while  the 
coupling  of  slow  phenomena  is  strong.  This  fact 
enables  us  to  reduce  the  dynamic  equations  of  intra 
area  variables  outside  the  study  area  to  the  static 
equations  (l.S),  while  retaining  the  study  area  in 
detail.  A  further  simplification  is  to  neglect  all 
the  equations  for  the  intra  area  variables  outside  the 
study  area  by  assuming  that  the  angles  between  ma¬ 
chines  are  constant,  which  is  the  approach  used  in 
[A],  These  three  approximations  are  demonstrated  on  a 
48  machine  system. 


2.  ELECTROMECHANICAL  MODEL 

The  well-known  electromechanical  model  [8]  of  an 
n-machine  power  system  is 

6  =  0(iu.  -  1),  (2.1) 

i  i 

=  -D.Ou.-l)  ♦  (Pai*Pei).  (2-2) 

i  =  1,  2,  .  .  . ,  n, 

where  6  .  ,  ui,  ,  P  .  ,  P  .  ,  H.,  D  are  the  rotor  angle, 
speed,  lmechanicai  lffput  lpowelr,  electrical  output 
power,  inertia  constant,  damping  constants  of  machine 
i,  respectively,  and  0  is  the  base  frequency.  In  this 
model  the  following  assumptions  are  made. 

(Al)  Mechanical  input  power  P  is  constant. 

(A2)  The  electrical  output  powir  is 


P  =  I  V . V . [B  . sin(6  -6 . )+G  . cos (6  -6  ) 1+V*G  ., 
ei  j=1  i  Jl  ij  i  J  ij  i  J  i  ii 


k  s  Z  -k  jPi  (2.6) 

j*l 

kij  1  *ViVjBijC0,(W  6*  •  J**  (2  7) 

in  which  the  terms  involving  are  neglected. 

At  6*  and  w*,  if.-  eigenvalues  of  (2.4)  and  (2.5) 
are  of  the  following  three  types: 

1 .  a  zero  eigenvalue  corresponding  to  the  motion  of 
all  the  machine  angles, 

2.  a  small  negative  real  eigenvalue  corresponding  to 
the  aggregate  speed  of  all  the  machines,  and 

3.  (n-1)  pairs  of  lightly  daa^ed  oscillatory  modes 
which  typically  range  in  frequency  from  1/2  to  2 
Hz. 

Models  involving  more  details  such  as  excitation 
systeau  and  governors  would  still  contain  the  above 
set  of  eigenvalues  modified  mostly  in  the  daaqiing  and 
not  in  their  frequencies  [4).  Since  the  small  daaqiing 
constants  do  not  significantly  affect  the  fre¬ 
quencies  of  the  oscillatory  modes  they  may  be  ne¬ 
glected.  Thus,  the  linear  model  used  in  this  paper  is 
the  second  order  system 


x  *  -(l/ZJOH*^  x  —  Ax , 


where  x  *  66.,  H  =  diag  (H,,H, . H  ).  and  K  is  the 

sutrix  if  k ...  Therefore  instead  of°dealing  with  a 
system  of  order  2n,  we  only  need  to  deal  with  the  nxn 
matrix  A. 

From  (2.6)  and  (2.7),  K  is  symmetric  if  Y  is 
symmetric  which  is  true  for  networks  without  phase 
shifters.  Thus,  A  is  diagonalizable  because  it  is 
similar  to  the  symmetric  matrix 

-(l/2)fW*l/2KH‘1/2  (2.9) 

1/2 

where  H  is  the  square  root  of  H.  Thus,  all  the 

eigenvalues  A.  of  A  are  real.  For  A  negative,  the 
eigenvalues  of  the  second  order  sVstem  (2.8)  are 

on  the  isMgina^y  axis  close  to  the  slightly  damped 
eigenvalues  of  (2.4)  and  (2.5).  Thus,  the  low  fre¬ 
quency  nodes  of  (2.4)  and  (2.5)  are  the  slow  modes  of 
A. 


where  the  per  unit  voltage  V  behind  transient  re¬ 
actance  is  assumed  to  be  constant  and  saliency  is 
neglected.  Loads  are  represented  by  passive  impe¬ 
dances,  and  G  and  B  are  the  real  and  imaginary  parts 
of  the  reduced  admittance  matrix  Y  at  the  internal 
machine  nodes. 

Disturbances  are  represented  by  initial*  condi¬ 
tions,  and  in  the  case  of  structural  changes,  by 
changes  in  the  Y  matrix.  The  time  scales  are  largely 
determined  by  the  natural  frequencies  of  the  lin¬ 
earized  electromechanical  model  around  the  equilibrium 

5*  and  ui*  =  1.0, 
i  i 


06  -  flOw.  , 


2H.0w  a-DOw  •  I  k  .66., 
11  1  1  j  =  i  ‘J  J 


where  06  -  6.-6*,  Ow.  -  tu.-l, 

i  ill  i 


3.  SLOW  COHERENCY 

In  this  section  we  study  systems  in  which  it  is 
possible  to  group  the  owchines  into  r  areas  such  that 
the  difference  t..(t)  in  (1.1)  contains  none  of  the  r 
slow  modes.  Sue)? ^idealized  systems,  in  which  the  slow 
coherency  is  exact  and  the  number  of  coherent  areas  is 
equal  to  the  nua&er  of  slow  srades,  are  called  r- 
decomposable .  In  r-decomposable  systems  there  exists 
a  direct  relationship  between  the  time  scales  and  the 
coherent  areas.  This  relationship  is  established  in 
this  section  and  serves  as  a  basis  for  the  development 
of  the  grouping  algorithm  in  the  next  section. 

Let  us  first  define  a  compact  notation  for  areas 
by  introducing  a  reference  set  of  machines  and  a 
grouping  matrix.  In  each  area  we  pick  an  arbitrary 
machine  as  the  reference  machine.  The  reference 
machine  angles  are  then  considered  as  components  of  an 
r-vector  jt  ,  while  all  other  angles  form  the  (.n-r)- 
vector  x  .  Equation  (1.1)  motivates  the  use  of  a 
grouping  matrix  L  of  diswnsion  (n-r)xr  to  assign 
machines  to  are^.®  L  has  as  many  rows  as  the  nuaiber 
of  machines  in  x^  and  ^s  many  coluama  as  the  number  of 


la  step  2  •  basis  for  the  5-diaensional  (low 
subspace  is  coaputed.  In  step  3  the  Gaussian 
elimination  is  performed  end  the  set  of 
reference  aechinea  is  found  to  be  S,  12,  14, 
IS,  16.  In  step  4  the  dichotoaic  L.  corre¬ 
sponding  to  this  reference  set  is  coaputed 
sad  is  given  in  Table  4.1.  The  largest 
eleaent  in  each  row  of  L.  which  are  under¬ 
lined  in  Table  4.1,  are  used  to  identify  the 
aachines  in  each  area.  As  a  result  the 
following  area  grouping  of  aachines  is  ob¬ 
tained: 

Area  1:  aachines  1-9 

Area  2:  aachines  10-13 

Ares  3:  sa chine  14 

Area  4:  aachine  15 

Ares  5:  aachine  16. 

Vote  that  for  aachines  1,  2,  3,  and  8,  Che 
entries  in  the  coluan  under  auchine  12  are 
not  significantly  ssuller  than  those  under 
aachine  S.  This  caa  be  interpreted  that  the 
responses  of  1,  2,  3,  and  8  are  only  slightly 
aore  coherent  co  5  Chan  to  12.  Nevertheless , 
this  area  grouping  gives  quite  favorable 
results  as  it  will  be  deaonstrated  in  the 
next  section. 

INTERMACHINE  AND  AREA  VARIABLES 


TABLE  4.1.  Matrix  Ld 


Other 

; 

Reference  Machines 

Machines 

.  14 

12  j  15 

^  re 

5 

— 

4  -  - 

• 

-A.  ■ 

1 

1 . 0599 

.411  -.0156 

.0222 

.522 

2 

|.0335 

.4221-. 0135 

.0014 

.557 

3 

1.0320 

.387  -.0132 

-.000466 

.595 

4 

,.0221 

.178  -.00818 

.00225 

.806 

6 

.0217 

.193  -.00971 

-.00404 

.799 

7 

.0227 

.198  -.00987 

-.00312 

-793 

8 

'.0585 

.377  -.0170 

.0186 

•  S63 

9 

,.0372 

.215. -.0183 

-.00352 

.769 

10 

.100 

.618  '-.0179 

.110 

.189 

11 

1-0720 

. 643 | - . 000447 

.133 

.152 

13 

1.00140 

.972;-. 00116 

.  .  .  t 

.0197 

.00794 

The  substitution  of  (5.1)  into  (3.6)  yields 


’z1' 

\ 

P(M)' 

-zl- 

? 

L° 

B2  - 

z2 

which  shows  that,  if  M  satisfies 


Using  the  fraaevork  of  singular  perturbation 
theory  we  now  show  that  an  area  decoaposition 
is  an  essential  step  in  two  tine  scale  and 
reduced  order  node ling.  A  aodel  is  singular¬ 
ly  perturbed  if  soae  of  its  states  are  pre- 
doainantly  slow  and  others  predoainantly 
fast.  The  two  tiae  scale  property  can  be 
exhibited  by  the  different  choices  of  the 
state  variables.  For  linear  tiae  invariant 
aodels  a  possible  choice  are  the  nodal  vari¬ 
ables.  However,  a  frequent  requireaent  is 
that  the  states  be,  or  at  least  closely 
reflect,  the  actual  variables  of  physical 
units  in  the  systen.  We  are  therefore  inter¬ 
ested  in  a  physically  aeaningful  choice  of 
state  variables  which  in  addition  exhibits 
the  tiae  scale  properties. 


P(M)  a  MBj-BjM  ♦  A12  =  0  (5.3) 

then  z^aB.z1.  Hence  z1  contains  only  slow 
nodes  and  represents  a  possible  choice  of  the 
slow  variables.  Is  this  choice  physically 
aeaningful?  To  answer  this  question  we  need 
the  following  result  whose  proof  is  given  in 
the  Appendix. 

Leans  5.1 

Consider  the  aatrix  A*-(1/2)0H  2K  of  (2.1) 
where  K  is  syanetric  and  H  is  the  diagonal 
natrix  of  aachine  inertias  whose  rxr  and  (n- 
r)x(n-r)  diagonal  blocks  are  H  and  IT, 
respectively.  Then  the  solutions  L  of 
R(L)=0  and  M  of  P(M)«0  are  related  by 


The  state  variables  of  the  original  eleetro- 
aechanical  aodel  (2.1),  (2.2)  and  its  linear¬ 
ization  (2.4),  (2.5)  are  physically  aeaning¬ 
ful  but  each  of  then  contains  aixed  slow  and 
fast  parts.  However,  if  the  systea  is  nesr- 
decoaposable  and  the  near-coherent  areas  have 
been  found,  than  the  aodel  (3.6)  exhibiu  the 
fast  part  z^B.z  .  The  fast  states  z  are 
physically  meaiTingful.  They  represent  the 
interaachine  oscillations  x.-x.  of  the  Ma¬ 
chines  i  and  j  within  an  »r#» , Jvhere  aachine 
j  is  the  reference  aachine  of  the  area.  The 
other  states  x1  of  the  aodel  (3.7)  still  have 
"aixed"  fast  and  slow  parts  and  should  be 
replaced  by  soma  predoainantly  slow  states. 


M  *  (K1  *  L’H2!)*1!’!!2  .  (5-4) 

A  siailar  relationship  can  be  obtained  by 
nodal  aethods  (Saccoaano,  1974a).  Under  the 
conditions  of  this  Leans  the  coaplete  trans¬ 
formation  froa  x  to  z  variables  (3.5)  and 
(5.1)  is 


Ht  a  H1  ♦  L'H^l.  (5.6) 


Knowing  that  the  slow  eigenvalues  of  A  are  in 
B^,  we  now  separate  the  slow  subsystea  using 


V 

"i  m" 

V 

_z2_ 

= 

_0  I_ 

z2_ 

If  the  systea  is  r-deeoaposabie, jthat  is  L*L 
then  the  physical  meaning  of  z  is  readilf 
recognized  froa  the  first  row  of  (5.5)  that 
it  froa 


^z1  *  hV  ♦  L'H2x2 


(5.1) 


(5.7) 


by  noting  the  special  structure  of  L’H2  and 
H  .  Since. the  entries  of  L  are  tens  and 
ones  and  H  is  diagonal,  the® nonzero  entries 
of  L’  are  replaced  in  L'lT  by  the  entries  of 
n  •  ®Furthermore,  t'H-L  *is  diagonal,  because 
L'L  is  diaguul.  *IC  Can  be  teen  that  each 
ehtry  of  L'H  L  is  the  sua  of  machine  iner¬ 
tias  in  an  ®are#  excluding  the  inertia  of  the 
reference  machine  in  that  area.  Thus  H  is 
a  diagonal  aatrix  of  the  area  inertias,  that 
is 


*  2  Hj,  for  all  j  in  area  i.  (S.8) 

It  follows  that  the  i-th  component  zj  of  z1 
is  1 

z*  =  I  lTXj/Hti,  for  all  j  in  area  i  (5.9) 

and  hence  its  physical  aeaning  is  the  faail- 
iar  notion  of  the  "area  center  of  inertia," 
which  has  been  used  in  Marconato,  Marian!  and 
Saccoaano  (1973). 


In  conclusion  we  emphasize  that  for  an  r- 
decomposable  systesi  an  area  decomposition 
results  in  physically  aeaningful  slow  and 
fast  variables .  For  near-decomposable  sys¬ 
tems  we  still  use  the  area  variables  (5.9) 
and  the  interaachine  differences  (3.1)  as 
states.  Although  the  time  scale  separation 
is  not  complete,  the  area  variables  z1  will 
be  predominantly  slow  and  the  interaachine 
variables  zl  will  be  predominantly  fast.  The 
same  conclusion  applies  to  models  with 
damping  (2.4),  (2.5)  and  nonlinear  models. 


As  an  illustration  we  will  consider  the  2nx2n 
linearized  model  (2.4),  (2.5)  which  includes 
daeqiing.  We  define,  z  to  represent  both 
angles  and  speeds:  z1  for  the  area  variables 
and  zi  for  the  interaachine  variables.  Then 
the  model  (2.4),  (2.5)  becomes 


(5.10) 


The  singular  perturbation  approach  in  Koko- 
tovic  and  others,  1980)  is  to  use 

*!‘WaF2i»*iir.*i  (5-u> 

to  approximate  the  slow  subsystem  and 

=  F  z2 
zf  t22zf 


V 

F12 

V 

i2 

L  J 

L'« 

F22_ 

(5.12) 

to  approximate  the  fast  subsystem  of  (5.10). 


We  now  examine  this  approximation  on  our  16- 
machine  example,  with  the  areas  defined  in 
the  preceding  section.  As  an  indication  of 


accuracy,  we  compare  the  eigenvalues  of  F  in 
(5.11)  and  F„  in  (5.12)  with  the  accurate 
eigenvalues.  As  Table  5.1  shows,  the  worst 
error  is  3.6X  for  the  pair  -.08790  ♦  j4.53i. 
In  this  example  even  though  L.  is  not  very 
close  to  L  ,  especially  in  rows  1,  2,  3,  and 
8,  the  eigenvalue  approximation  is  excellent. 


TABLE  5.1.  tizenvalue  Approxi- 
~~~  nations  of  the  if 

Machine  System 


Sub¬ 

system 

Accurate 

Singular 

Perturbation 

Approximation 

Slow 

[ 

.0002318 

-.1969 

-.1063  ♦  J  2 . 5  76 
-.09877  7  J3.498 
-.08970  7  j 4. 531 
-.09399  7  j5 . 068 

.0002318 

-.1969 

-.1058  ♦  J2.S89 
-.09882  7  j 3 . 496 
-.09097  7  J4.695 
-.09385  7  J5.075  ; 

|  Fast 

: 

-.1294  ♦  J5.997 
-.1162  7  J6.534 
-.1178  7  j7.l59 
-.07192  7  J7.485 
-.1198  7  j7.962 
-.09360  7  j7.970 
-.08926  7  j8.405 
-.1350  7  j9.267 
-.1007  7  j9.650 
-.1264  7  j9. 732 
-.2013  7  jll.419 
J 

-.1219  ♦  J5.975  ! 

-.1222  7  J6.44S 
-.1177  7  J7.156 
-.07207  7  J7.481 
-.1195  7  j7 .962 
-.09425  7  j 7 . 959 
-.08873  7  J8.259 
-.1351  7  J9.267 
-.1025  7  j9.646 
-.1264  7  j9. 732 
-.1986  7  jll.378 

CONCLUSION 

The  concepts  of  slow  coherency  and  r-decom- 
posable  systems  have  exhibited  the  time  scale 
properties  and  retained  the  physical  meaning 
of  the  fast  and  alow  variables  in  electroam- 
chanical  models  of  the  power  systems.  The 
time  scale  interpretation  of  the  notion  of 
coherent  areas  has  provided  an  analytical 
basis  for  the  grouping  algorithm  proposed  in 
this  paper. 

The  algorithm  uses  the  dichotomic  solution  of 
a  lower  order  Riccati  equation  expressed  in 
terms  of  a  basis  of  the  slow  eigensubspace. 
First  a  basis  is  found,  and  then  a  particular 
dichotomic  solution  is  obtained  via  Gaussian 
elimination.  A  grouping  matrix,  which  is  the 
closest  approximation  of  the  dichotomic 
solution,  can  be  obtained  and  used  to  define 
areas.  This  algorithm  is  illustrated  by  a 
16-machine  example.  Although  the  areas  are 
determined  on  a  simplified  linearized  model, 
it  is  expected  they  can  be  used  to  bring  more 
detailed  and  nonlinear  models  to  a  singularly 
perturbed  form.  This  opens  new  possibilities 
for  obtaining  nonlinear  lower  order  equiva¬ 
lents  by  singular  perturbation  techniques. 
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APPENDIX 

We  start  with  the  proof  of  Leaaa  4.2  because 
the  proof  of  Learnt  4.1  is  easily  obtained 
froa  tbe  proof  of  Lcsbm  4.2. 

Proof  of  Leaaa  4,2 

Since  the  columns  of  V  fora  a  basis  of  the 
slow  eigensubspace,  then  there  exists  a 
aatrix  A  whose  eigenvslues  are  equal  to  the 
slow  eigenvalues  of  A  such  that  AV*VA  whose 
partitioned  fora  is 

A11V1  *  *12V2  "  V  (Al) 

A21V1  *  A22V2  *  V'  (A2) 


where  A. .  ere  the  subeMtrices  of  A  of  appro¬ 
priate  (fiVensions . 

Preaultiplyiag  (Al)  by  V.^  and  using  it  to 
eliminate  A  froa  (A2)  yields 

A2iVA22VVI1(AU  VA12V2)b°  (A3) 

Thus,  ( 3 . 1 OJ  follows  froa  post-aultiplying 
(A3)  by  V,  ,  aad  L,  is  ideatified  as  ia 
(4.3).  Furthermore, 

B1  *  A11  *  A12L  *  VlAVll  (M) 

can  be  obtaiaed  froa  post-aultiplyiag  (Al)  by 
V*1,  implying  that  the  eigenvalues  of  B.  are 
toe  slow  eigenvalues.  The  uniqueness  of  L, 
follows  froa  Medaaic  (1979). 

The  proof  of  the  second  part  of  the  leaaa 
follows  froa  the  first  part.  SiAce  V  is  of 
full  rank,  there  are  aore  than  1  coabiaatioa 
of  the  rows  of  V  forming  a  aoaaiagular 
aatrix  V. ,  aad  hence  the  stateaeat  is  mean¬ 
ingful.  1 

Proof  of  tiaas  4.1 


Froa  the  proof  of  Leaaa  4.2,  if  u  is  aa 
eigenvector  of  Bj,  then 


(A5) 


is  an  eigenvector  of  A. 
v=vq ,  then  froa  (PI), 


k  1 

V 

a 

LduoJ 

i_ 

In  particular,  if 


(Ad) 


Thus  (4.1)  is  obtained  by  writing  ia 

scalar  fora. 


Proof  of  L 


5.1 


Let  us  first  rewrite  R(L)*0  and  P((1)=0  as 
0 


[-L  I]  «  [I]  ■ 


(A7) 

(AB) 


where  „ 
B  * 


*12 

J 

„-l 


Substituting  BvTjAT^1  into  (AB)  yields 
(I-ML  M]  A  f-H  1 

Ll-UlJ 

V  t I -ML  MJ  (-H*1K)H*lH  |"-M  1  (A9) 

Ll-Wj 

*  [(I-MLHH1)*1  MOf2)*1]  A'  f-H ^  > 

yr(I-LM)J 

Pre-  and  post-multiplying  (A7)  by  (H2(I-LM))' 
and  ( ( X -ML ) (H  )  l]'  and  comparing  to  the 
transpose  of  (A9),  we  obtain 


0. 


M’H1  *  (I-LM)'H2L 


(A10) 


which  siaplifies  to  (5.4). 


aachioea  ,1a  xl.  -The  (i,j)  entry  of  L  i*  1  if  aa- 
ehiaoi  xj  and  XT'  arc  la  the  Mat  arc!  and  it  xcro 
otherwise1. 

Ac  aa  illustration  conaider  a  three  area  five 
aachiae  systaa  with 

x1  *  (Xj,  Xj,  xs)T  (3-1) 

x2  *  (xv  x4)T  (3-2) 

s  -  ll  0  l]  •  (3-3) 

The  / iret.row  of  l  indicates  that  the  first  aachiae 
in  x2  belongs  to  th!  saae  area  as  the  third  aachiae  in 
x2,  and  the  second  row  of  L  indicates  that  the  second 
aachiae  in  xZ  belongs  to  fhe  aaae  area  as  the  first 
aachine  in  x  .  Thus  the  three  areas  coaposed  of 
aachiaes  5  and  1,  aachiaes  2  and  4,  and  aachiae  j)  are 
uniquely  defined.  For  a  different  choice  of  x  and 
x  ,  such  as 

xl  *  (Xj,  x2,  ,3)T  (3.4) 

«2  .  (x4,  x,)T  (3.5) 


we  need  a  different  that  is 

S  *  [J  0  Si  *  (3-6) 

to  define  the  saae  areas.  Note  that  the  zero  coluan 
in  L  of  (3.3)  or  (3.6)  indicates  the  presence  of  a 
sing  A  aachiae  area. 

Using  1.^,  (1.1)  is  rewritten  no  re  compactly  as 

x2(t)  -  xl(t)  «  z2(t)  (3.7) 

where  the  coaponents  of.  z2(t)  are  the  corresponding 
functions  z..(t).  For  x  ,x  and  L  defined  in  (3.1)  - 


2  *1  " 

z2(t)  »  I  1  s]  (3.8) 

*4  *2 

Our  procedure  interprets  (3.7)  as  a  special  case 
of  the  aore  general  coordinate  transformation 


x1  I  0  x1 

A  -t  i.  x2 


where  the  (n-r)xr  aatrix  L  is  not  necessarily  a 
grouping  aatrix.  The  application  of  the  transforma¬ 
tion  to  (2.8)  results  in 


z2]  j_R«.)  b2  J  ly 


B1  *  *11  *  *12L  ’  B2  *  A22 


R(l)  *  A22L 


U11  *  U12L  +  *21 


foraaf  ViUiH' 


are  the  subaatrices  of  A  con- 


We  are  particularly  interested  in  a  so  called 
dichotoaic  L  which  satisfies  R(L)  *  0  and  |\(Bj)|< 
|MB,)|  ,  that  is,  which  groups  the  slow  nodes  into1  the 
aatrix  B..  It  can  be  sbown  that  the  Riccati  equation 
R(L)*0  in  (3.12)  can  have  at  aoat  one  such  dichotoaic 
solution  L>Ld  (9).  Moreover,  for  r-decoaposable 


systeas  the  dichotoaic  solution  is  also  a  grouping 
aatrix,  that  is  t.*!  (9]!  and  any  choice  of  r  ma¬ 
chines  ,  each  froa  a  Afferent  area,  gives  an  L  which 
solves  R(L  )  •  0.  If  two  aachines  froa  the  saae  area 
were  in  ae  reference  set,  than  the  corresponding 
Riccati  equation  would  not  have  a  dichotoaic  solution. 

This  grouping  approach  has  a  geoaetrlc  repre¬ 
sentation  in  terms  of  a  basis  of  the  eigenaubspace  of 
the  slow  nodes  of  A  for  a  particular  ordering  of  the 
aachine  angles  in  x.  Considering  such  a  basis  as  the 
columns  of  aa  nxr  aatrix  V,  we  see  that  if  the  aa¬ 
chines  i  and  j  are  slowly  coherent,  the  ith  and  jth 
rows  of  V  must  be. identical.  If  no  awchines  froa  the 
aaae  area  are  in  x  ,  the  rxr  subaatrlx  V  of  the  basis 


is  nonsiagular  and  the  dichotoaic  solution  of  R(L)  « 
0  is  given  by  [9] 

Ld“L,  -Vi1-  (314) 

If  two  aachines  froa  the  saaa  area  are  in  x1,  then 
is  singular  since  it  has  two  identical  rows.  Hence  Ld 
does  not  exist. 

The  transforaation  of  (2.8)  ioto  (3.10)  with 
R(L)*0  decouples  the  fast  subaystea,  but  the  slow 
subsystem  is  still  coupled  through  A]2.  Knowing  that 
the  slow  eigenvalues  of  A  are  in  B, ,  %e  now  separate 
the  slow  subsystea  froa  the  fast.  Applying  the  trans- 
for-atjon  r _n 


■;*T  rmirv 
y.  1  .  .*2 


to  (3.10),  with  R(L)»0,  we  obtain 

’z'1]  (y  p(«)i  r*r 

.z2.  .0  B2  .  .z2.  . 

For  M  in  (3.15)  we  uae  the  solution  of 


P(M)  *  MB2  -  Bt  II  ♦  Aj2  *  0  (3.17) 

which  coapletely  separates  (3.16)  into  the  slow  and 
fast  subsystems .  It  has  been  shown  [9]  that  the 
solutiona  l  of  R(L  )  *  0  and  M  of  P(M)  *  0  are  re¬ 
lated  by  1  * 

H  »  (Hl  ♦  lVl^)*1!^2  (3.18) 

1  2 

where  H  and  K  are  the  ry  and  (n-r)x(n-r)  diagonal 
aatrices  of  the  x*  and  x4  machine  inertias  respec¬ 
tively. 

Thus,  the  complete  transformation  froa  the  x  to 
z  variables  using  (3.9)  and  (3.15)  is 


z1!  pfW  h*1  lV] 

A a  U,  i  J 


1  T  2 

H  *  H1  ♦  lVl  . 

a  8  8 


Since  the  entries  of  the  grouping  matrix  L  are  zeros 
and  ones  and  IT  is  diagonal  matrix  of  meAiine  iner¬ 
tias,  each  entry  in  L*H  l  is  the  sua  of  machine 
inertias  in  an  area  elclufting  the  inertia  of  the 


projections  of  the  vector  onto  the  other  reference 
vectors. 


r 


reference  aschine  in  that  area.  Thus,  H  is  a  dia¬ 
gonal  aatrix  of  the  area  inertias,  that  \s,  the  ith 
diagonal  eleaent,  H  , ,  of  H^  is  the  sua  of  all  the 
inertias  of  aachines  Th  area  a. 

Sot  an  r-decoaposable  aystea  the  physical  aeaning 
of  zr  and  zz  can  be  readily  determine!  by  exaaining 
(3.19).  We  see  that  the  fast  states  z1  represent  the 
fast  interaachine  oscillations  x.  -  x.  of  aachines  i 
and  j  within  an  area,  where  aachi&e  j  rs  the  reference 
aachine  of  the  area.  Froa  (3.19)  we  also  see  that 

Hz1®  hV  +  LTH2x2  (3.21) 

a  t 

and  it  follows  that  the  slow  states  of  z1  represent 
the  faailiar  center  of  inertia  variables,  that  is 
coaponent  wise 

z1  *  for  all  j  in  area  i.  (3.22) 

These  area  variables  are  the  weighted  suss  of  the 
aachine  angles  in  the  areas.  They  can  be  regarded  as 
the  angles  of  equivalent  aachines  for  the  areas  (1, 
2,4).  As  a  consequence  of  our  separating  the  tiae 
scales,  these  equivalent  aachines  have  larger  inertias 
and  hence  exhibit  slower  notions. 


4.  THE  GROUPING  ALGORITHM 

For  idealized  r-decoaposable  systeas  j  the  deter¬ 
mination  of  areas  araunts  to  finding  an  x1  vector  of 
reference  aachines  for  which  a  dichotoaic  solution  of 
R(L)  *  0  exists.  The  difficulty  with  realistic 
models,  which  are  not  exactly  r-decoaposable,  is  that 
in  general  for  a  given  x1  a  dichotoaic  solution  of 
R(L)  *  0  exists,  but  is  not  a  grouping  aatrix.  For 
such  realistic  situations,  we  present  a  group¬ 
ing  algorithm  to  determine  the  areas. 

We  begin  by  considering  the  case  when  the  slow 
coherency  definition  (1.1)  can  only  be  approximately 
satisfied.  Machines  ”i"  and  "j"  are  said  to  be  near- 
coherent  if  in  (1.1)  the  contribution  of  the  slow 
nodes  in  z.  (t)  is  small  in  aoae  prespecified  sense. 
Then  a  near ^coherent  area  is  an  area  composed  of  all 
aachines  which  are  near-coherent  to  each  other. 
Following  the  approach  for  r-decoaposable  systems,  we 
need  to  first  find  the  reference  aachines  and  then 
approximate  Ld  by  an  L  ,  since  now  Ld  is  different 
from  L  * 

« 

For  near-coherent  areas,  the  row  vectors  of  any 
slow  eigensubspace  basis  utrix  V  corresponding  to 
machines  in  the  saae  area  are  not  the  saae .  However, 
they  are  close  in  the  sense  that  they  are  of  approxi¬ 
mately  the  same  length  and  are  clustered  in  a  narrow 
cone.  There  are  r  such  nonintersecting  cones,  one  for 
each  area . 

To  identify  the  areas,  we  find  the  r  "most  lin¬ 
early  independent  vectors”,  one  froa  each  cone,  and 
use  them  as  the  reference  row  vectors.  After  that,  V 
is  reordered  such  that  V,  consists  of  the  reference 
row  vectors,  see  (3.13).  Recalling  that  *  V^V  7 , 
we  see  from  A 


that  the  entries  of  L,  are  the  projections  of  other 
rows  vectors  onto  the  reference  vectors.  Therefore, 
in  each  row  of  L.  the  entry  close  to  l  corresponds  to 
the  projection  of  the  vector  on  the  corresponding 
reference  vector,  and  the  entries  close  to  zero  are 


(4.1) 


An  important  property  of  L.  is  that  it  is  inde¬ 
pendent  of  the  scaling  of  V.  Given  a  basis  aatrix  V, 
any  other  basis  can  be  obtained  as 


VS  * 


where  S  is  an  rxr  nonsingular  aatrix.  The  aatrix  Ld 
is  invariant  to  this  change  in  basis,  that  is 

Ld  *  V2S  (vis>_1  *  V2Vi*-  (*-3) 

To  find  a  set  of  the  r  "most  linearly  inde¬ 
pendent"  row  vectors  to  be  used  as  the  reference  row 
vectors,  we  apply  Gaussian  elimination  with  coaqilete 
pivoting  to  V.  During  the  elimination,  the  rows  and 
columns  of  V  are  permuted  such  that  the  (1,1)  entry  of 
the  resulting  V  is  the  largest  in  aagnitude.  Note 
that  permuting  the  rows  of  V  is  equivalent  to  changing 
the  ordering  of  the  aachines.  This  (1,  1)  entry  of  V 
is  the  pivot  for  performing  the  first  step  of  the 
Gaussian  eliaination.  Then  the  largest  entry  froa  the 
remaining  (n-l)x(r-l)  submatrix  is  used  as  the  pivot 
for  the  next  eliaination  step.  The  eliaination  ter¬ 
minates  in  r  steps  and  the  aachines  corresponding  to 
the  first  r  rows  of  the  final  reduced  V  aatrix,  are 
designated  as  the  reference  aachines.  In  this  Gaus¬ 
sian  eliaination  process,  rows  having  small  entries 
will  not  be  used  as  the  pivoting  row  because  these 
small  entries  are  the  result  of  eliaination  with 
alaost  identical  rows  already  used  as  pivoting  rows. 
Thus,  the  algorithm  does  not  put  two  near-coherent 
aachines  into  the  reference  set. 

For  the  set  of  reference  machines  found  by  the 
algorithm  the  corresponding  Ld  is  readily  computed 
froa 

VI  Ld  *  VI  C4'4) 

using  the  LU  decomposition  of  already  obtained  from 
the  Gaussian  eliaination.  The  next  step  is  to  find  an 
approxiaating  Ld>  that  is  to  find  the  aachines  be¬ 
longing  to  each  area.  To  do  this  we  examine  each  row 
of  Ld-  If  the  largest  positive  entry  in  row  i  is  the 
jth  entry,  then  in  the  matrix  L  entry  (i,  j)  is  1  and 
all  other  entries  in  the  ith  row^re  0. 

Summarizing,  the  grouping  algorithm  consist  of 
four  steps : 

a.  computation  of  a  basis  V  for  the  slow  subspace  of 
A, 

b.  Gaussian  elimination  of  V, 

c.  coaputation  of  l.  by  (4.4), 

d.  approxiaation  oll^  by  an  L^. 

With  the  reference  machines  and  L  known,  the  areas 
are  determined.  8 

The  algorithm  is  efficient  because  its  most  time 
consuming  part  the  basis  calculation  in  step  a  is  only 
for  r  modes  where  r<<n  and  is  carried  out  on  the 
symmetric  aatrix  (2.9).  There  are  special  purpose 
programs  available  in  E1SPACK  which  make  use  of  these 
properties  for  handling  large  scale  systems. 

5.  APPLICATION  TO  A  NONLINEAR  MODEL 

The  grouping  algorithm  and  slow  coherency  pro¬ 
perties  are  now  examined  on  a  43  aachine  NPCC  test 
system  (tOj.  This  model  is  of  particular  interest 


V 

Vj 


(4.2) 


Figure  6.2  arc  an  approximation  to  the  alow  dynamic* 
present  in  the  intermachine  variable*  in  tha  faulted 
area.  The  (mailer  the  magnitude  of  theae  alow  dynam¬ 
ic*  the  closer  the  ay*t*m  is  to  aa  r-decomposable 
system.  Figure  6.3  illustrate*  the  respoase  of  indi- 
vidual  machine  angles  in  area  1  which  is  adjacent  to 
the  faulted  area.  The  close  agreement  between  the 
exact  curves  aad  the  approximation  implies  that  the 
fast  dynamics  in  area  1  is  small  even  though  the  fast 
dynamics  in  the  faulted  area  are  substantial. 


0  I  2  J  4  S 
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Figure  6.3:  Individual  machine  angles  area  1,  exact 

and  approximation  A1 


TIME  SECONOS 

Figure  6.4:  Individual  machine  angles  area  3,  exact 

and  approximation  A2 


This  localised  nature  of  the  fast  dynamics  can  be 
used  to  improve  approximation  A1  by  including  the 
differential  equations  of  the  fast  difference  vari¬ 
ables  in  the  study  area.  Thus,  for  this  approximation 
(A2)  we  have  a  set  of  differential  equations  for  both 
the  area  variables  aad  the  intermachine  difference 
variables  in  the  study  area.  The  external  inter- 
machine  difference  variables  are  modeled  with  e*0, 
that  is  with  a  set  of  atdtic  equations.  Figure*  6.4, 
6.5,  and  6.6  show  the  close  egreesMnt  between  E  and 
A2.  The  differences  between  these  curves  are  due  to 
the  neglected  fast  dynamics  in  the  external  areas. 
Thus ,  A2  curves  are  more  accurate  than  those  of  A1 . 
However,  both  approximations  provide  the  correct 
steady  state  value. 
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Figure  6.6:  Individual  machine  angles  area  1,  exact 

and  approxiaution  A2 
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Figure  S.2:  Angular  difference  variable*,  area  S 
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Figure  5.4:  Angular  difference  variable*,  area  9 


6.  APPROXIMATE  SIMULATIONS 

From  the  above  diacuaaion  we  have  shown  that  the 
tine  acale  properties  are  preserved  in  the  nonlinear 
aodel.  Having  expressed  the  ay a tern  dynamics  in  the 
for*  of  (1.2)  and  (1.3)  we  preaent  three  different  ap¬ 
proximate  simulation*  of  the  Medway  fault. 

After  the  fault  waa  cleared,  we  aet  e  *  0  for  the 
entire  faat  subsystem  and  obtain  a  *et  of  equationa  in 
the  fora  of  (1.4)  and  (1.5).  With  thia  approxiaation 
(Al)  the  »low  dynaaica  are  in  differential  equation 
fora  (1.4)  and  the  alow  part  of  the  faat  dynamic*  are 
repreaented  by  a  aet  of  atatic  equation*  (1.5). 
Figure*  6.1,  6.2  and  6.3  ahow  the  cloae  aggreeaent 
between  the  exact  aolution  (E)  and  the  approxiaation 
Al  for  aelected  aachinea  in  the  faulted  at  well  at 
adjacent  area.  The  error  introduced  by  thi*  approxi¬ 
aation  it  only  in  the  faat  dynaaica  and  there  i*  no 
ateady  state  error  between  Al  and  E.  The  Al  curvet  in 
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Figure  6.1:  Individual  machine  angles  area  5,  exact 
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If  eh*  test  system  war*  truly  an  r-decomposable 
lytta  the  difference  variables  would  contain  no  slow 
ares  notions.  Figure  6.2  indicates  how  close  our 
systen  is  to  an  r- decomposable  systea.  If  we  oaks  the 
assiwption  that  the  test  systesi  is  r-decoaposable  and 
that  the  fast  dynaaUcs  are  strictly  local  to  the  study 
area  then  the  intensachine  difference  variables 
reaain  constant  outside  the  faulted  area.  This  ap- 
proxiaation  is  basically  siailar  to  the  equivalencies 
technique  used  in  [4]  ■  Errors  introduced  by  this 
approximation  (A3)  will  be  both  in  the  fast  variables, 
for  the  same  reasons  as  discussed  above,  and  in  the 
slow  variables,  which  will  have  a  steady  state  error. 
This  steady  state  error  is  due  to  the  fact  that  we 
have  constrained  the  angular  differences  between 
SMcbiaes  outside  the  study  area  to  be  the  saae  as  the 
pre-fault  equiiibriua  conditions.  These  angular 
differences  are  represented  as  phase  shifters  in 
(4].  In  approximation  A2,  these  angles  are  allowed  to 
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Figure  6.7:  Individual  machine  angles  area  5,  exact 
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vary  with  time.  Depending  on  the  post- fault  equi¬ 
librium  this  may  or  may  not  be  a  significant  error. 
The  agreement  between  approximation  A3  and  the  exact 
solution  E  is  shown  in  Figures  6.7,  6.8  and  6.9. 
Within  the  study  area.  Figures  6.7,  6.8,  the  agreement 
remains  good.  However,  A3  curves  for  area  1  (Figure 
6.9)  do  not  compare  as  well  to  the  exact  curves  as  in 
previous  eases.  This  is  due  to  the  approximation  of 
the  intermachine  difference  variables  as  constants. 


Figure  6.9:  Individual  machine  angles  area  1,  exact 
and  approxisMtion  A3 

7.  CONCLUSIONS 

The  concepts  of  slow  coherency  and  r-decosq>osable 
systems  have  exhibited  the  time  scale  properties  in 
electrosMchsnical  models  by  introducing  a  set  of 
physically  meaningful  fast  and  slow  variables.  These 
variables  are  obtained  through  the  dichotomic  trans¬ 
formation  which  is  the  solution  of  a  lower  order 
Riccati  equation.  A  grouping  algorithm  is  formulated 
to  find  a  particular  dichotomic  solution,  from  which 
the  grouping  matrix  can  be  obtained  and  used  to  define 
the  areas. 

Through  the  48  machine  system,  we  show  that  the 
areas  obtained  from  linear  analysis  are  valid  for 
nonlinear  simulations  and  are  fault  location  inde¬ 
pendent.  Three  types  of  approxiSMtions  using  the 
singular  perturbation  technique  are  illustrated.  By 
neglecting  all  the  intermachine  variables,  the  slow 
variables  reproduce  the  area  motions.  The  accuracy  of 
the  simulation  is  improved  by  including  also  the 
intermachine  dynamics  in  the  study  area.  Without  much 
loss  in  accuracy,  the  intermachine  variables  in  the 
external  ares  can  be  kept  constant.  These  approxi¬ 
mations  offer  new  approaches  to  reduced  simulations 
for  power  system  studies. 
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If  the  test  system  were  truly  so  r-decoapossble 
systesi  the  difference  variables  would  cootain  no  slow 
area  notions.  Figure  6.2  indicates  how  close  our 
system  is  to  an  r-decoaposable  systta.  If  we  make  the 
assumption  that  the  test  systea  is  r-decoaposable  and 
that  the  fast  dynaaics  are  strictly  local  to  the  study 
area  then  the  interaachine  difference  variables 
remain  constant  outside  the  faulted  area.  This  ap- 
proxiaation  is  basically  siailar  to  the  equivalencing 
technique  used  in  (4].  Errors  introduced  by  this 
approximation  (A3)  will  be  both  in  the  fast  variables, 
for  the  saae  reasons  as  discussed  above,  and  in  the 
slow  variables,  which  will  have  a  steady  state  error. 
This  steady  state  error  is  due  to  the  fact  that  we 
have  constrained  the  angular  differences  between 
Mchines  outside  the  study  area  to  be  the  saae  as  the 
pre-fault  equilibriua  conditions.  These  angular 
differences  are  represented  as  phase  shifters  in 
[4],  In  approxiaation  A2,  these  angles  are  allowed  to 
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Figure  6.7:  Individual  machine  angles  area  3,  exact 
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Figure  6.8:  Angular  difference  variables  area  3, 
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vary  with  time.  Depending  on  the  post-fault  equi¬ 
libriua  this  nay  or  nay  not  be  a  significant  error. 
The  agreeaent  between  approxiaation  A3  and  the  exact 
solution  E  is  shown  in  Figures  6.7,  6.8  and  6.9. 
Within  the  study  area,  Figures  6.7,  6.8,  the  agreeaent 
reaains  good.  However,  A3  curves  for  ares  1  (Figure 
6.9)  do  not  coevare  as  well  to  the  exact  curves  as  in 
previous  cases.  This  is  due  to  the  approxiaation  of 
the  interaachine  difference  variables  as  constants. 
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Figure  6.9:  Individual  machine  angles  area  1,  exact 
and  approxiaation  A3 

7 .  CONCLUSIONS 

The  concepts  of  slow  coherency  and  r-decomposable 
systems  have  exhibited  the  time  scale  properties  in 
electromechanical  models  by  introducing  a  set  of 
physically  meaningful  fast  and  slow  variables.  These 
variables  are  obtained  through  the  dichotomic  trans- 
formation  which  is  the  solution  of  a  lower  order 
Riccati  equation.  A  grouping  algorithm  is  formulated 
to  find  a  particular  dichotomic  solution,  from  which 
the  grouping  matrix  can  be  obtained  and  used  to  define 
the  areas. 

Through  the  48  machine  system,  we  show  that  the 
areas  obtained  from  linear  analysis  are  valid  for 
nonlinear  simulations  and  are  fault  location  inde¬ 
pendent.  Three  types  of  approxiaMtions  using  the 
singular  perturbation  technique  are  illustrated.  By 
neglecting  all  the  interaachine  variables,  the  slow 
variables  reproduce  the  area  motions.  The  accuracy  of 
the  simulation  is  iaqiroved  by  including  also  the 
intermachine  dynaaics  in  the  study  area.  Without  much 
loss  in  accuracy,  the  interaachine  variables  in  the 
external  area  can  be  kept  constant.  These  approxi¬ 
mations  offer  new  approaches  to  reduced  simulations 
for  power  system  studies. 
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Singular  Perturbation  of  Linear  Regulators: 

Basic  Theorems 

PETAR  V.  KOKOTOVlC  and  RICHARD  A.  YACKEL,  member,  ieee 


Abstract — Th«  behavior  of  the  solution  of  the  Riccsti  equation 
for  the  linear  refulator  problem  with  a  parameter  whose  perturbation 
chances  the  order  of  the  system  is  analyzed.  Sufficient  conditions 
are  given  under  which  the  solution  of  the  original  problem  tends  to 
the  solution  of  a  low-order  problem.  This  result  can  be  used  for  the 
decomposition  of  a  high-order  problem  into  two  low-order  problems. 

Introduction 

HE  DEPENDENCE  of  the  solution  of  a  linear 
regulator  problem  on  a  parameter  whose  small 
perturbation  can  change  the  order  of  the  system  is  analyzed. 
The  system  considered  is 

-77  =  Axx  +  Aiz  +  Biu,  x(io)  -  x°  (la) 

at 

X  —  »  A&  +  AiZ  -1-  5jU,  z(to)  -  z°  (lb) 

at 

where  X  is  a  small  positive  scalar,  x  and  z  are  n-  and  Tri¬ 
dimensional  states,  respectively,  and  u  is  an  r-dimensional 
control.  The  performance  index  to  be  minimized  is 

J»r 

{ij'Dy  +  u'Ru)  dt  (2) 

fe 

where  y  =  Cxz  +  C&  «  CX  is  an  s-dimensional  output, 
X  is  the  ( n  +  m)-dimensional  state  of  (1)  and  C  = 

In  physical  systems  our  parameter  X  represents  small 
time  constants,  masses,  moments  of  inertia,  etc.1  Following 
his  intuition  and  experience  a  designer  usually  neglects 
these  small  parameters  during  the  design  of  a  regulator 
system.  He  has  at  least  two  strong  practical  reasons  for 
this  simplification.  An  evident  reason  is  that  the  presence 
of  these  “parasitic”  parameters  can  make  the  dimen¬ 
sionality  of  a  dynamic  system  prohibitively  high.  Another, 
less  apparent,  reason  is  that  equations  describing  systems 
with  small  parameters  multiplying  derivatives  belong  to  a 
class  of  “stiff”  differential  equations,  which  are  difficult  to 
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1  For  example,  if  T  is  a  small  time  constant  and  .1  f  is  a  small 
mass,  then  we  can  write  T  -  ai\  and  .1/  -  a»X,  where  cu  and  a,  are 
appropriate  coefficients. 


.solve  even  when  the  dimensionality  of  the  system  is  not 
high  [I], 

In  the  method  of  this  paper  the  small  parameter  X  is  not 
neglected  in  the  state  equation  (1),  but  rather  in  an 
appropriately  formulated  Riccati  system  for  the  regulator 
problem  (1),  (2).  At  X  «  0  this  “full”  Riccati  system  is 
decomposed  into  two  smaller  Riccati  systems,  one  corre¬ 
sponding  to  the  variable  z,  and  the  other  corresponding 
to  the  variable  x.  An  efficient  decomposition  is  achieved 
since  the  z  Riccati  system  does  not  depend  on  the  x 
Riccati  system  and  thus  can  be  solved  separately.  It  is  of 
practical  importance  that  the  z  Riccati  system  is  algebraic 
rather  than  differential,  even  for  a  finite  time  interval 
problem.  In  contrast  to  the  full  Riccati  system  (9),  the 
two  smaller  Riccati  systems  (11c)  and  (16)  constitute  a 
“reduced”  system.  In  Theorems  1  and  2  conditions  are 
formulated  under  which  the  full  solution  tends  to  the 
reduced  solution  as  X  -*■  0+.  Hence,  for  X  sufficiently  small, 
the  reduced  solution  can  be  used  as  an  approximation  of 
the  full  solution.  In  a  future  paper  [2]  an  asymptotic 
expansion  method  is  developed  which  improves  this 
approximation. 

To  appreciate  the  nontriviality  of  the  perturbation 
problem  considered,  note  that  at  X  =  0  the  matrices 


of  the  state  equation  (1),  that  is,  of  the  system 

^  -  AX  +  Bu,  X (to)  -  X°,  (4) 

at 

may  be  unbounded  at  X  =  0.  To  analyze  this  singular 
perturbation  problem  a  “boundary  layer”  concept  is 
introduced  in  the  Riccati  system.  The  “thickness”  of  this 
layer  is  a  short  time  interval  (<i,  tr\  during  which  a  rapid 
transient  of  the  z  Riccati  system  decays.  Asymptotic 
stability  of  this  transient  is  a  crucial  condition  in  most 
theorems  of  singular  perturbation  theory  [3],  [4],  Readers 
unfamiliar  with  singular  perturbation  theory  are  referred 
to  theorems  of  Levin  and  Levinson  [a )  and  Hoppensteadt 
[6]  in  the  Appendix. 

This  paper  is  organized  as  follows.  After  preliminary 
notation  and  definitions  the  main  result  is  presented  in 
Theorem  1.  This  result  is  then  extended  to  the  infinite 
time  interval  (tf  =  =°)  problem.  Theorem  2.  It  should  be 
noted  that  in  Theorem  2  the  existence  and  uniqueness  of 
the  full  solution  is  established  via  controllability  and 
observability  test  for  the  reduced  system,  thus  avoiding 
the  difficulty  with  the  unboundedness  of  matrices  .1  and  B 
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as  X  -*  0.  Singular  perturbation  of  linear  regulators  was 
first  considered  in  [7  ].  This  result  now  appears  as  a  special 
case  of  Corollary  2. 

Preliminary  Definitions 

In  the  regulator  problem  (1),  (2)  the  following  usual 
conditions  are  set  for  £  £  (to,  £/]  and  X  £  [0,  X0]. 

1)  .Ii,  .ili,  Xt,  Xt,  Si,  Si,  and  C  are  continuous  in  £  and 
X. 

2)  R  and  D  are  positive  definite  and  continuous  in  f 
and  X. 

3)  F  is  time  invariant,  positive  semidefinite,  and 
continuous  in  X. 

It  is  well  known  [8]  that  under  these  conditions  and 
for  X  >  0  and  t,  finite  the  optimum  control  is 

U  *  —R-'B'RX  (5) 

where  R  is  the  solution  of 

~  -  -  RX  -  X’R  +  RBR-'B'R 

at 

-  C'DC,  R(t f)  -  CPC  (6) 

and  the  optimum  regulator  system  is 

?  -  (A  -  BR~'B'R)X.  (7) 

at 


reduces  to  a  system  of  one  differential  and  two  algebraic 
equations,  called  the  degenerate  system, 

^  -  -Ki(Ax  -  SKS)  -  (A,  -  SKi'YKi 

+  KySiKi  -  KiAi  -  Ai'Ki' 

+  KtSiKi  —  Qu  Ki(h)  ”  lit  (11a) 

0  -  KiiSiKt  -  ,4,)  -  KiAt  -  At'Kt 

+  K\SKi  —  Qt  (lib) 

0  -  -K^  -  Ai'Kt  +  KiSiKi  -  Q,  (11c) 

where  the  absence  of  a  tilde  above  a  matrix  denotes  the 
evaluation  of  that  matrix  at  X  —  0. 

Note  that  as  X  -*■  0  in  (9)  the  derivatives  dRt/dt  and 
dRi/dt  may  tend  to  infinity  since,  in  general,  Kt  —  III 
and  Kt  *  11,  do  not  satisfy  (lib)  and  (11c)  and  thus  the 
right-hand  sides  of  (9b)  and  (9c)  are  not  zero  at  X  =»  0 
and  £  -  tr.  Hence,  in  an  interval  about  tr  the  solution  (9) 
differs  markedly  from  a  solution  of  (11)  and,  since  dRt/dt 
and  dRt/dt  are  large,  Rt  and  Ri  rapidly  change  in  this 
interval.  This  interval  is  called  the  boundary  layer 
because  of  an  analogy  with  problems  in  fluid  dynamics 
[9].  To  analyze  this  boundary  layer  phenomenon  the 
following  boundary  layer  system  is  introduced: 

-  Lt(r)[Si(t)L,(r)  -  .4,(1)]  +  [K,(£)S(t) 


Partitioning  R,  Q  -  C'DC,  and  ft  *  C' PC  into  n  by  n, 
n  by  m,  and  m  by  m  arrays, 


and  denoting  5!  =  B,R~'B,' ,  Sj  =  8;R~'R7',  and  S  - 
BxR~xBi,  we  rewrite  (6)  as 


~  -  -RJx  -  Xi'Ri  -  RiX,  -  Xi'RY  +  R&Ri 

+  R\SRt'  +  RtS'Rx  +  RiSiRi'  -  <2,  (9a) 

X'-r-  *  — —  \Xi'Rt  —  Xi'Ri  +  \Ri5iRt 
at 

+  RiSR,  +  xRtS'Ri  +  RtSiRi  -  Qt  (9b) 

(ij*L 

X— 7“  *  ~ 

at 

4-  \*Rt8\Rt  4“  \Rz  SRi  4"  xA  iS'K-i 
+  R*8iRt  -  Qi  (9c) 

with  the  end  condition 

Rxib)  -  fti,  Ri(tf)  «  ft-,  R,(t,)  -  ft,.  (10) 

The  preceding  form  of  R  makes  the  Riccati  system  (9) 
suitable  for  singular  perturbation  analysis.  This  system  is 
called  the  full  system.  If  X  is  zero,  the  full  system  formally 


-  A,'(t))L,(r)  -  KtQA, (0  -  Qj(0  (12a) 
-  -L,(r).4,(£)  -  At'(l)Li(r) 

+  Ur)Si(t)L,(r)  -  Q,(t)  (12b) 

where  the  independent  variable  is  r.  and  t  is  considered  as  a 
fixed  parameter,  £  £  [f0,  £/].  The  variable  r  is  often  referred 
to  as  “fast  time”  since  (12)  can  be  viewed  as  being  ob¬ 
tained  from  (9)  by  the  use  of  the  “stretching”  trans¬ 
formation  t  =«  Xr  +  tr  and  allowing  X  -*•  0,  see  [3.  p. 
254].  Using  (12b)  we  now  introduce  two  important 
definitions. 

1)  The  system  (1)  is  called  boundary  layer  controllable 
if  for  each  fixed  £  £  [£o,  £/] 

rank  [£,,  AiBi,  •  •  ■ ,  d,"-IBs]  =»  m.  (13) 

2)  The  system  (1)  is  called  boundary  layer  observable 
if  for  each  fixed  £  £  [£0,  tr] 

rank  [CV,  A,'CV,  •  •  • ,  (.4,')"’-1C'2']  =  m.  (14) 

Next  note  that  a  solution  of  the  degenerate  system 
(11)  is  not  unique,  since  (11c)  has  several  roots.  It  will  be 
shown  in  Lemma  1  that  a  unique  positive  definite  root 
Kt  of  (11c)  exists  such  that  (.4,  —  S2K,]  has  an  inverse 
for  all  £  £  [£o.  £/■].  Then  the  root  Kt  of  (lib)  is  uniquely 
defined 

Kt  -  (KtSKt  -  KtAt  -  At’Kt  -  Qt) 

(A,  -  StK,)-'.  (15a) 
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The  stability  of  the  root  is  discussed  in  Lemma  2.  Given 
Kt,  the  root  Kt  is  a  linear  function  of  Kx 

K,  -  KiEi  -  Et  (15b) 

where 

Ex  -  (SK,  -  A,)(A<  -  StKi)~l 
Ex  -  (A,'X,  +  QxHA,  -  S*Kx)-'.  (15c) 

Substituting  Kt  into  (11a)  gives 

-  -KxA  -  A’Kx  +  KxER-'B’Kx  -  0, 

at 

Kx(t,)  «  n,  (16) 

where 

A  —  A\  +  E\Ax  +  SE,’  ExSxEt’  ( 1 7a) 

B  «■  Bx  ■+■  ExBt  ( 17b) 

Q  -  -EtA,  -  A,' Ex'  -  EtSxEx'  +  Q,.  (17c) 

The  system  (16),  along  with  Kt  and  K,  defined  pre¬ 
viously,  is  called  the  reduced  system.  The  dimensionality 
of  the  reduced  system  (16)  is  n  by  n,  while  the  dimen¬ 
sionality  of  the  full  system  (9)  is  n  m  by  n  +  m.  The 
existence  and  uniqueness  of  the  solution  of  (16)  will  be 
established  later  in  Lemma  3. 


of  the  solution  to  the  reduced  system  (16).  Finally, 
Lemma  4  guarantees  that  the  asymptotic  stability  of  the 
boundary  layer  system  (12)  is  uniform  with  respect  to  t 
which  is  the  essential  condition  for  the  application  of 
Theorem  L  in  the  Appendix. 

Lemma  1 

Let  conditions  l)-5)  be  satisfied.  Then  for  each  fixed 
t  G  [<o,  tf],  first,  there  exists  a  unique  positive  definite 
root  Kt(t)  of  (11c);  second,  this  root  is  an  asymptotically 
stable  equilibrium  of  (12b)  as  r  -*  —  » ;  third,  III  belongs 
to  the  domain  of  attraction1  of  this  root;  and  fourth, 

a(t)  -  A,(t)  -  Sr(t)K,(t)  (20) 

is  a  stable  matrix.1 

Proof:  The  lemma  follows  directly  from  well-known 
results  of  the  output  regulator  theory  for  completely 
controllable  and  observable  plants  [8],  [10]  since  for  each 
fixed  i  G  [to,  tf]  conditions  l)-5)  insure  thut 

J-  -  A,(t)z(r)  +  Bx(t)u(r)  (21a) 

dr 

J  =  *  /  V(r)<2,(0*(r)  +  u'(r)R(t)u(r) )  dr  (21b) 
is  a  well-defined  regulator  problem. 


Main  Theorem 

Theorem  1 

Let  conditions  l)-3)  be  satisfied  and  assume  that  the 
system  (1)  is 

4)  boundary  layer  controllable; 

5)  boundary  layer  observable. 

Then  for  t  G  [<o,  M  and  X  G  [0.  X®]  the  unique  solution 
E(t,  X)  of  (9)  with  R(t/,  X)  ==  ft  exists  on  the  interval 
[to,  </]  and 


lim  Ex(t,  X)  *  Kx(t), 

t  €  Ik,  t,] 

(18) 

A— 0 

lim  Rt (ty  X)  * 

t  G  [L>,  tf) 

(19a) 

A— *0 

lim  X)  *  Ki(t ), 

a— o 

t  G  [(«■  tr) 

(19b) 

where  Kt(t)  is  the  unique  positive  definite  root  of  (lie), 
Kt(t)  is  defined  by  (15)  and  A\(f)  is  the  unique  solution 
of  the  reduced  system  (16).  The  limit  (IS)  is  uniform  in  t 
on  the  interval  [f0,  tf]  and  the  limits  (19)  arc  uniform  in  t 
on  any  interval  [/o,  ft],  where  <i  is  arbitrarily  close  to  tf, 
tx  <  tf. 

The  proof  of  this  theorem  is  carried  out  in  four  lemmas. 
In  lemma  1  it  is  shown  that  boundary  layer  control¬ 
lability  and  observability  (13),  (14)  insure  that  the 
solution  Lx(t)  of  the  boundary  layer  equation  (12b)  will 
be  attracted  to  the  asymptotically  stable  positive  definite 
root  K,(t )  of  (11c)  for  each  fixed  t  G  ((<>,  t,].  Lemma  2 
gives  a  similar  result  for  (12a)  and  (lib)  at  t  »  tr.  In 
Lemma  3  these  facts  assure  the  existence  and  uniqueness 


Lemma  2 

If  conditions  l)-5)  are  satisfied  then  the  root  of  (lib) 
at  t  lt 

Kx(tf)  -  [n„S(<,)K,(f,)  -  n.d,(</)  -  A,'(t,)K,(t,) 

-  Qi(t,)]a-\tf)  (22) 

is  an  asymptotically  stable  equilibrium  of  (12a)  as  r  -*• 
—  00  . 

Proof:  Rewrite  (la)  as 

-  -Lx(r)[a(t,)  +  0(r,  t,)]  +  T(r,  (,)  (23) 

dr 

where 

d(r,  tf)  $,((,)  [*,(«,)  —  Lj(r)]  (24a) 

"f(r,  tf)  “  — ni[Aj((r)  —  S(tf)Lx(r)]  —  Ax' (tf)Lx(r) 

—  Qx(tf).  (24b) 

In  view  of  known  results  for  the  stability  of  linear  systems, 
see  [12,  p.  70,  theorem  9],  it  follows  that  if  a)  3(t,  (,)  -► 
0  as  r  -*  —  ® ,  and  b)  Lx(r)  —  0  is  an  asymptotically 
stable  equilibrium  of 

”  —Lx(r)a{tf)  (25) 

dr 

then  Kx(tf)  is  an  asymptotically  stable  equilibrium  of 
(16).  Condition  a)  is  satisfied  by  (24a).  To  prove  b)  let 

1  Following  Hahn  [II)  a  matrix  is  called  stable  if  all  its  eigenvalues 
have  negative  real  parts.  The  domain  of  attraction  is  also  defined  in 

HU. 
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ms_rr*<x>  r“W 

w  Lr«(x)  r»(x). 


(32) 


where 


1,(t)  be  the  ith  row  of  Lt  and  consider  (25) 
r  -  -  Mb)  -  St(tr)K,(tf)]h  i  -  1,2,...,  n. 

dr 

(26) 

Since  by  Lemma  1  [.4«(t,)  —  S*(tr)Ki(t,)  ]  is  a  stable  matrix, 
the  null  solution  of  (26)  is  an  asymptotically  stable 
equilibrium  asr-*  —  « . 

With  Lemmas  1  and  2  we  satisfy  condition  L2  in  the 
Appendix.  To  satisfy  the  condition  L3  we  establish 
the  existence  and  uniqueness  of  the  solution  Ki(t)  of  the 
reduced  system  (23). 

Lemma  3 

If  conditions  l)-5)  are  satisfied,  then  0  is  positive 
semidefinite  and  therefore  the  solution  Ki(t)  of  the 
reduced  system  (16)  exists  and  is  unique  on  the  interval 
[to,  t/]. 

Proof:  It  follows  from  [8]  that  if  R  is  symmetric  positive 
definite,  and  Q  and  IIi  are  symmetric  positive  semidefinite; 
then  the  solution  K\  exists  and  is  unique  on  the  interval 
[to,  tr\.  To  show  that  Q  is  symmetric  positive  semidefinite 
we  apply  a  matrix  identity  from  (11c)  to  (17c)  to  obtain 

Q  -  «3i  +  AyKt)(A<'K,  +  Q,)-'Q,(A<'Kt  +  &)'-' 

(Qi  +  A,'K,y  ~  QMiK,  + 

+  KiA,)  -  (Q,'  +  KtAty(At'K ,  +  Qj)-1Q3' 

+  Qi-  (27) 

For  an  arbitrary  vector  8  let 

v  -  8  and  to  -  -  (A/K,  +  Q,)'~l  ( Qt  +  At'K»Y9.  (28) 

Since  by  condition  2)  Q  is  positive  semidefinite, 

0'Qd  —  v'QiV  -f  v'Qiw  +  vi'Qi'v  +  w'QzW  >  0.  (29) 

Thus  0  is  positive  semidefinite.  Since  condition  3)  implies 
the  positive  semidefiniteness  of  III,  and  R  is  positive 
definite  by  assumption,  all  the  conditions  of  [8]  for  the 
existence  and  uniqueness  of  Kt(l)  are  satisfied. 

Finally  we  show  in  Lemma  4  that  the  Jacobian  of  the 
system  (9b)  and  (9c)  evaluated  along  the  reduced  solution 
is  a  stable  matrix  as  required  by  the  condition  L4  in  the 
Appendix.  Map  the  matrices  Rh  Rt,  and  Rj  into  nn, 
nm,  and  mm-vectors  Ki,  Kt,  and  Ki,  respectively,  and 
rewrite  (9)  in  vector  form 

^  -  fx(Ku  Kt,  t,  X)  (30) 

x^1  -  MR t,  Rv  R„  t,  X)  (31a) 

at 

(31b) 

at 

The  Jacobian  r(\)  of  [ftf*]'  then  given  by 


r<.,(X)  -  (Kx,  K,,  K„  t,  X),  t,  j  -  2,  3.  (33) 

OiWj 

Let  r(0)  denote  T(X)  evaluated  along  the  reduced  solution 
Ki(0,  Kx(t),  Kt(t). 


If  conditions  l)-5)  are  satisfied  then  all  the  eigenvalues 
of  T(0)  have  positive  real  parts  for  t  G  [to,  tt\. 

Proof:  Since  rtt(0)  —  0  the  eigenvalues  of  T(0)  consist  of 
the  eigenvalues  of  ra(0)  and  those  of  r«(0).  Note  that 
ra(0)  and  r„(0)  can  be  expressed  in  terms  of  Kronecker 
products  [13], 

r«(0)  =  -(A,  -  StK,y  X  Iy  (34a) 

r»(0)  =»■  ~I.it  X  (A*  —  SiKt)1  —  (A4  —  StKi)'  X  I. it 

(34b) 

where  IN  and  IM  arc  n  X  n  and  m  X  m  identity  matrices. 
Therefore,  the  mm  eigenvalues  of  r«(0)  are  m<  +  M/> 
i,  j  =»  1 ,  ■  ■  ■ ,  m,  and  the  nm  eigenvalues  of  rn(0)  are 
tii,  i  =  1,  •  •  • ,  m,  each  one  of  which  is  of  multiplicity  n, 
where  n„  i  *=  1,  •  •  • ,  m  are  the  eigenvalues  of  —  (A4  — 
StKi),  see  [14].  Since  by  Lemma  1  all  the  eigenvalues 
Hi,  i  *  1,  •  •  • ,  n,  have  positive  real  parts,  all  the  eigen¬ 
values  of  T  have  positive  real  parts. 

With  Lemmas  1-4  we  satisfy  all  the  conditions  of 
Theorem  L  in  the  Appendix.  This  completes  the  proof  of 
Theorem  1. 

When  A4(t)  is  a  staple  matrix,  Theorem  1  can  be  ex¬ 
tended  to  systems  which  are  not  boundary  layer  control¬ 
lable  or  observable.  Corollaries  1  and  2  deal  with  two 
extreme  situations. 

Corollary  l 

Let  conditions  l)-3)  bo  satisfied  and  instead  of  condi¬ 
tions  4)  and  5)  assume  that  for  all  fixed  t  G  [to.  t/J 

6)  Ai(t)  is  stable; 

7)  Bj(t)  *  0. 

Then  the  results  of  Theorem  1  still  hold. 

Proof:  Lemma  1  holds  since  (12b)  is  an  asymptotically 
stable  Lyapunov  equation,  and  Lemmas  2,  3,  and  4  hold 
since  St(t)  *  0  and  a(t)  -  .4*(t)  —  5s(t)K,(t)  *  A4(t)  is  a 
stable  matrix  for  all  fixed  t  G  [to,  t,]. 

Corollary  2 

Let  conditions  l)-3)  be  satisfied  and  instead  of  condi¬ 
tions  4)  and  5)  assume  that  for  all  fixed  t  G  [to,  t /] 

7)  A,(t)  is  stable; 

8)  Q,(t)  ■■  0. 

Then  using  the  root  Ki(t)  •>  0  of  (11c)  the  results  of 
Theorem  l  still  hold.  p 


Lemma  4 
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Proof:  The  result  of  Lemma  1  for  the  unique  positive 
definite  root  Ki(t)  of  (11c)  now  applies  to  the  isolated1  root 
Kt(t)  =*  0  of  (lid  with  Qi(t)  =  0.  This  result  for  the 
Riceati  equation  (12b)  with  Qj(<)  =  0  is  known  from  [15], 
[16].  Since  a(t)  =  .1,(0  —  St(t)K}(t)  =  A4(<)  is  a  stable 
matrix  for  all  fixed  1 £  [fo,  </],  Lemmas  2—4  still  hold. 

A  special  case  of  Corollary  2,  when  A4(f)  is  negative 
definite  and  11*  *  0  was  considered  in  [7]. 

As  a  further  extension  it  may  be  shown  that  Theorem  1 
will  still  hold  if  conditions  4)  and  5)  are  violated,  but 
uncontrollable  or  unobservable  modes  of  (21a)  are  asymp¬ 
totically  stable. 

Time-Invariant  Problem 

An  important  class  of  regulator  problems  occurs  when 
tf  »  «  and  the  system  (1)  and  C,  D,  and  R  in  (2)  are 
time  invariant.  For  the  finite  time  interval  problem  the 
existence  of  the  solution  of  the  full  system  (9)  is  assured 
by  the  conditions  1  )-3)  which  are  easily  checked.  The 
existence  problem  for  (9)  when  t,  =  °°  is  harder  since  the 
controllability  and  observability  of  A,  S,  and  C  must  be 
checked  for  all  \  £  [0,  X0].  This  is  particularly  difficult 
for  X  very  small,  since  .1  and  B  contain  terms  Aj/X, 
AJ\,  and  Bj/X.  This  difficulty  is  avoided  in  Theorem  2 
where  controllability  and  observability  conditions  of  the 
reduced  system  guarantee  the  existence  and  uniqueness 
of  the  solution  of  the  full  problem  for  X  sufficiently  small. 
A  second  result  of  Theorem  2  is  that  the  reduced  solution 
approximates  the  full  solution  for  X  sufficiently  small. 

For  the  time-invariant  problem,  conditions  l)-3)  are 
modified  as  follow's: 

I*)  Au  Jj,  .Ij,  .f4,  Bu  Bi,  and  C  are  time  invariant 
and  continuous  in  X  for  X  £  [0,  X0]; 

2*)  R  and  D  are  symmetric  positive  definite,  time 
invariant,  and  continuous  in  X  for  X  £  [0,  X0]; 

3*)  F*0. 

Theorem  2 

Let  conditions  l)-3*)  and  4)  and  5)  be  satisfied.  Also 
assume  that  the  matrices  of  the  reduced  system  (17) 
satisfy 

9)  rank  \C',  'A,£",  •  •  • ,  (A')*_1£']  -  n  where  C  is  a 
solution  of  C’C  -  0/ 

10)  rank  [B,AB,  •  •  • ,  (A)"-1#]  **  n. 

Then  for  sufficiently  small  X  the  asymptotically  stable 
equilibrium  i?”(X)  of  the  full  system  (9)  exists.  Moreover, 

lim  £,*(X)  -  K,’,  i  -  1,  2,  3  (35) 

A—0 

where  KR  is  the  asymptotically  stable  equilibrium  of  the 
reduced  system  (11). 

Proof:  The  structure  of  the  proof  is  to  divide  the  time 
interval  into  two  parts  t*  <  t  <  t,  and  —  ®  <  {  <  t*. 
We  apply  the  result  of  Theorem  1  to  the  first  interval 


since  it  is  finite  and  then  show  that  the  hypotheses  of  a 
theorem  by  Hoppensteadt  (Theorem  H  in  the  Appendix) 
are  satisfied  on  the  second  interval. 

If  conditions  l*)-3*)  and  4)  and  5)  are  satisfied  then 
by  Theorem  1  there  exists  a  X*  >  0  and  a  t*  <  f/such  that4 
jj R(tm,  X*)  —  K(<*)|j  <  e  for  an  «  which  satisfies  the  € 
closeness  requirement  of  Theorem  H.  Furthermore,  (9) 
has  the  unique  solution  R(t,  X*)  on  [t*,  tf\  satisfying  the 
end  condition  R(t/,  X*)  «•  0  and  R(t,  X)  -*■  K(t)  as  X  -*■  0 
on  [<*,  h]  where  t*  <k<tf. 

Hypotheses  Hi,  2,  4,  5  of  Theorem  H  are  evidently 
satisfied  by  the  form  of  (9)  and  conditions  l)-3).  From 
the  results  of  the  linear  regulator  theory,  conditions 
l*)-3*)  and  9)  and  10)  insure  the  existence  and  asymptotic 
stability  of  the  solution  Ki(t)  of  (16)  on  (—  00 ,  1*],  as 
required  by  H3  and  H6.  The  crucial  hypothesis  H7  is  that 
the  solution  of  the  boundary  layer  equation  (12)  be 
asymptotically  stable  uniformly  in  initial  conditions 
and  the  parameters  (  and  Ki  for  t  £  (—  ®,  1*]  and  Ki 
positive  definite.  By  1*)  and  3*)  the  system  (12)  does  not 
depend  on  t,  nor  does  (12b)  contain  Kt.  Hence  by  Lemma  1 
the  solution  L 3  of  (12b)  satisfies  H7.  By  Lemma  2  the 
solution  Lt  of  (12a)  is  asymptotically  stable  uniformly  in 
Ki.  This  completes  the  proof  of  Theorem  2.  Extensions 
similar  to  Corollaries  1  and  2  are  immediate. 

Two-Stage  Design 

L'sing  the  results  of  Theorems  1  and  2,  the  linear 
regulator  design  can  be  decomposed  into  a  two-stage 
procedure.  At  the  first  stage  the  algebraic  system  (11c) 
is  solved  for  Ki(t).  At  the  second  stage  the  differential 
system  (16)  is  solved  for  Ki{t),  and  Kt(t)  is  evaluated 
using  the  explicit  formula  (15). 

This  decomposition  and  reduction  of  dimensionality  is 
particularly  efficient  in  finite  time  interval  problems  with 
time-invariant  systems.  In  this  case  the  accurate  design 
requires  solution  of  the  full  l/2(n  +  m  +  l)(n  +  mi- 
dimensional  differential  system  (6),  and  the  whole  regula¬ 
tor  matrix  R{t.  X)  is  time-varying,  while  in  the  two-stage 
design  the  reduced  differential  system  (16)  is  1/2  (n  +  l)n 
dimensional.  The  time-invariant  K,  is  easily  obtained  by  an 
algebraic  method  and  is  less  expensive  to  implement  than 
£»(<,  X). 

A  familiar  speed  control  problem  for  a  small  dc  motor  is 
used  to  demonstrate  the  two-stage  regulator  design. 
The  motor  state  equation  is 

^  -  (D/G)i  (36a) 

at 

xLdl  -  -Cm  -  Rti  +  t>  (36b) 

at 

where  w,  i,  and  v  are  speed,  current,  and  voltage  deviations 
from  their  respective  nominal  values  400  rad/s,  0.25  A, 
11.8  V.  The  motor  constants  are  Ra  *  7,90,  L  =•  0.0136  H, 


■That  Ki(l )  »  0  is  not  a  multiple  root  follows  from  the  non- 
singularity  of  the  Jacobian  Tn  in  Lemma  4. 


4  The  norm  of  a  matrix  is  taken  to  be  the  sum  of  the  absolute 
values  of  its  elements. 
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Fig.  1.  Optimal  and  reduced  Riccati  gains  and  K,. 


C  «  0.0246  V- s/rad,  G  -  1.32  X  10"4  kg-m*.  In  (36)  the 
armature  inductance,  being  a  small  parameter,  is  multiplied 
by  a  factor  X.  Let  the  performance  index  be 

,  o.oiu1  r 

J  -  —5—  +ij0  (<*’  +  460 Oi*  +  30v>)  dt.  (37) 

Even  in  this  extremely  simple  problem  the  full  system 

dR 

— 1  -  3.6  Rt  +  180.£,*  -  1,  Rx(tf)  -  0.01  (38a) 

dR 

*  -18654&  4-  5811?,  +  1.81?,  +  180 R,Rt  (38b) 

dR 

x-^  *  -  X37308 R,  +•  11621?,  +  18Qi?,’  -  4600  (3Sc) 

with  1?,  and  1?,  zero  at  t  —  tf,  must  be  solved  on  a  com¬ 
puter.  Note  that,  at  t  -  tr,dR,/dl  »  -4600/X,  and  hence 
for  X  »  1  the  change  of  Rt  is  4600  times  faster  than  the 
change  of  1?,,  so  that  (38)  can  be  considered  a  stiff  system. 
In  the  degenerate  system 

dKi 

—  -  3.61?,  4-  1801?,-  -  1,  Ki(tr)  -  0.01  (39a) 

0  -  -18654K,  +  581 K.  +  1.81?,  +  180  KJCZ  (39b) 

0  -  11621?,  +  1801?,*  -  4600  (39c) 

the  positive  definite  root  of  (39c)  is  Kt  =  2.77.  Solving 
(39b)  for  1?,  ■»  17.3  K\  —  0.0046,  and  substituting  it  in 
(39a)  we  obtain  the  reduced  system 

dKt 

—  -  331?  1  +  536831?,*  -  1.013,  !?,(*,)  -  0.01  (40) 

which  can  be  solved  analytically.  The  reduced  solution 
l?,(<)i  ff,(t),  and  Kt  is  shown  as  dashed  curves  in  Figs. 


1-3.  The  solid  curves  represent  the  full  solution  Ri(t,  X), 
Rt(t,  X),  and  R,(t,  X)  for  different  values  of  X.  From  the 
family  of  curves  in  Fig.  1  it  is  apparent  that  the  limiting 
process  Ri(t,  X)  -*•  K,(t)  is  uniform  on  the  whole  interval. 
The  families  of  curves  in  Figs.  2  and  3  show  that  the 
limiting  process  for  Rz(t,  X)  and  f?,(t,  X)  takes  place  for 
t  <  t,  -  10  ms.  The  convergence  is  not  uniform  on  the 
whole  interval  due  to  the  boundary  layer  phenomenon 
near  t,. 

A  shortcoming  of  the  two-stage  design  method  pre¬ 
sented  here  is  that  it  does  not  give  an  estimate  of  a  range 
X  £  [0,  X°)  in  which  the  reduced  solution  can  be  used  as  a 
“good”  approximation  of  the  full  solution.  Although  the¬ 
oretically  important,  this  shortcoming  does  not  seem  to  be 
critical  in  regulator  design  practice.  Recall  that  even 
when  the  accurate  R  is  designed  several  trials  for  weighting 
matrices  R  and  Q  are  made,  and  the  resulting  system  is 
tested  before  an  acceptable  control  is  found.  Thus  no 
loss  of  system  performance  will  occur  when  these  trials 
are  carried  out  with  the  reduced  solution  J?  1,  Kt,  and  Kt. 

The  two-stage  design  has  been  introduced  using  full  and 
reduced  Riccati  equations.  This  procedure  can  now  be 
interpreted  by  an  analysis  of  the  full  and  reduced  state 
equations  of  the  resulting  regulator  system.  In  an  imple¬ 
mentation  of  the  control  law  (5),  Kt,  Kt,  and  K,  are  used 
instead  of  Ri,  Rt,  and  Rt 

u  -  -R-'KBt'Kt  f  Bt'Kt)x  +  (XS,'K, 

+  S,'f?,)z]  (41) 

and  the  full  state  equation  of  the  regulator  system  be¬ 
comes 

*  *•  (A,  —  Si K  —  SKt')x  4-  {Xt  —  Si?,  —  xs,i?,)z 

(41a) 


a  HUH 
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Fig.  2.  Optimal  and  reduced  Riccati  gains  Rt  and  Kt. 


Fig.  3.  Optimal  and  reduced  Riccati  gains  Rt  and  Kt. 


\t  -  (I,  -  S'Kt  -  5iKt')x  +  (14  -  StRi-  \S'Kt)z. 

(41b) 

The  reduced  state  equation  is  unique  since  (A,  —  SjKi)-1 
exists  and 

0  -  (At  -  S'Ki  -  StKt')x  +  (A,  -  StK,)t  (42) 


can  be  uniquely  solved  for  t.  The  state  equation  (41) 
satisfies  all  the  hypotheses  of  Theorem  L  in  the  Appendix, 
and  therefore  the  full  solution  will  tend  to  the  reduced 
solution  as  X  -*■  0+.  Note  that  i  exhibits  a  boundary 
layer  near  t  -  U  and  that  this  layer  is  controlled  by  the 
solution  of  the  regulator  problem  (21)  in  Lemma  1.  Thus 
the  first  stage  of  the  two-stage  design  procedure  is  used  to 
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design  a  boundary  layer  regulator  for  the  m-dimensional 
state  z.  To  interpret  the  second  stage  the  root  of  (42)  is 
substituted  into  (41a)  with  X  *  0  and,  using  the  notation 
(15b)  and  (17a),  (17b),  the  reduced  state  equation  can  be 
written  in  compact  form 

i  =  Ax  +  (43) 

where 

u  -  -R-'&'Ktx.  (44) 

It  is  apparent  from  (16),  (43),  and  (44)  that  in  the  second 
stage  the  reduced  regulator  system  (43)  is  optimized  with 
respect  to  the  performance  index  defined  by  R  and  Q. 

Conclusion 

Notions  of  boundary  layer  controllability  and  ob¬ 
servability  have  been  introduced  to  establish  sufficient 
conditions  for  the  solution  of  a  higher  order  linear  regulator 
problem  to  tend  to  the  solution  of  a  lower  order  problem 
as  a  parameter  X  tends  to  zero.  For  X  sufficiently  small  a 
two-stage  procedure  greatly  simplifies  the  design  of  a  linear 
regulator.  The  results  of  this  paper  are  also  applicable  to 
other  problems  involving  matrix  Riccati  equations  such 
as  filtering,  estimation,  and  nonlinear  trajectory  optimiza¬ 
tion  via  second  variation  techniques. 

Appendix 

Consider  the  initial  value  problem 


/(«,  £,  7,  X), 

£(<«)  m  £0 

(45) 

g(t,  £,  7,  x), 

v(to)  =*  7o 

(46) 

where  X  is  a  small  positive  parameter  and  £  and  7  are  n- 
and  m-dimensional  vectors,  respectively.  Formally  setting 
X  =*  0  in  the  full  system  (45)  and  (46)  gives  the  degenerate 
system 

^  m  f(t,  £,  7,  0),  ((to)  =“  £o  (47) 

0  -  g(t ,  l  H,  0).  (48) 

Since  (48)  may  have  several  roots,  suppose  that  a 
particular  root  7  —  e(t,  £)  is  of  interest  and  substitute  it  in 
(47).  The  n-dimensional  system 

^  ”  /(<•  ?,  ^(*,  £).  0],  »  £o  (47') 

is  a  reduced  system  of  (45),  (46). 

Introducing  a  new  time  variable  r  (46)  is  rewritten  in 
the  form  of  a  boundary  layer  system, 

7^  -  g( a.  <r.  0).  <r(0)  -  no  (49) 

dr 

where  a  *  to  and  3  m  £o  are  fixed  parameters.  In  the  space 
of  variables  £,  n>  X,  t  we  define  a  region  (R:  ||£  —  £(()||  < 


r,  111  —  n(0l|  <  0  <  X  <  X®,  to  <  t  <  tf  where  r  > 

Ino  —  n(<o)i  >  0. 

Theorem  L  [41 

Let  the  following  conditions  be  satisfied. 

LI:  /,  d//d{,  df/dv,  g,  dy/d%,  dg/dri  are  of  class  C°  in 
(£,  7>  t,  X)  £  <R. 

L2:  The  solution  ir(r)  of  (50)  exists  on  r  g  [0,  «),  is 
unique,  and  is  asymptotically  stable  with  respect 
to  the  root  t{U>,  £0)  of  (48). 

L3:  The  solution  £(f)  of  the  reduced  system  (47') 
exists  and  is  unique  on  t  £  [to,  t,]. 

L4:  The  real  parts  of  the  eigenvalues  of  the  Jacobian 
matrix 

3g/dv(t,  ?,  7,  0)  (50) 

are  negative  on  [to,  tf],  for  7  =  v»(t,  f). 

Then  for  sufficiently  small  X,  the  full  system  (45),  (46) 
has  a  unique  solution  £(t,  X),  n(t,  X)  on  t  £  [<o,  t,}  satisfying 
the  initial  conditions  £(to,  X)  =  £0,  7(<o,  X)  =*  70.  Further¬ 
more, 

lim  £(t,  X)  *  £(t)  on  [Io,  tf]  (51) 

\—o 

lim  »j (t,  X)  =•  rj(t)  on  (to,  (,]  (52) 

X-K) 

where  the  limit  (51)  is  uniform  in  t  on  [to,  t,)  and  the  limit 
(52)  is  uniform  in  t  on  any  interval  [fi,  tr],  where  to  < 
ti  <  t,. 

Theorem  H  [S] 

Let  tf  -  ®  in  the  definition  of  <R,  and  denote  by  Q  its 
(n  +  l)-dimensional  subspace  in  £  and  t.  Let  the  following 
conditions  be  satisfied. 

Hi:  /,  g,  df/d£,  df/di 7,  dg/dt,  dg/d%,  dg/dv  are  of  class 
C1  for  all  (t,  £,  7,  X)  £  (R. 

H2:  There  exists  a  bounded  function  7  *  <p(£>  t)  of 
class  C*  which  is  an  isolated  root  of  g(t,  £,  <?(!,  £), 
0)  »  0  for  all  (£,  f)  £  0. 

H3:  The  solution  £(t)  of  the  reduced  system  (47'), 
corresponding  to  the  isolated  root  7(f)  exists  on 

[<o.  ®). 

H4:  The  function  /  is  of  class  C°  at  7(f)  —  rj(t),  X  «■  0 
uniformly  in  (£,  t)  £  $1  and  /(t,  £,  ij(t),  0)  and 
df/df(t,  £,  >i(t),  0)  are  bounded  in  Q. 

H5:  The  function  g  is  of  class  C°  at  X  »  0  uniformly  in 
(t,  £,  7)  €  51  and  g,  dg/dt,  dg/d$,  dg/dy  at  X  <■  0 
are  bounded  on  (R. 

H6:  The  solution  of  the  reduced  system  is  uniformly 
asymptotically  stable. 

H7:  The  solution  of  the  boundary  layer  system  is 
uniformly  asymptotically  stable  uniformly  in  the 
parameters  (a,  3)  £  8. 

If  the  t  closeness  requirement  |j7o  —  <p(to,  £o)l|  <  «  is 
satisfied  for  a  sufficiently  small  e,  then  for  a  sufficiently 
small  X  the  solution  of  the  full  system  exists  for  to  <  t  <  06  • 
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Furthermore,  the  limits  (51)  and  (52)  hold  uniformly  on 
all  closed  subsets  of  k  <  t  <  <*> . 


References 

( l]  C.  W.  Gear,  “The  numerical  integration  of  stiff  differential 
equations,”  Dep.  Comput.  Sci.,  Univ.  Illinois,  Urbana,  Rep. 
221,  Jan.  1967. 

[2J  R.  Yackel  and  P.  Kokotovic,  “Singular  perturbation  theory  o. 
linear  state  regulators,  asymptotic  expansions,”  to  be  published. 

[31  W.  R.  Wasow,  Asymptotic  Expansions  for  Ordinary  Differential 
Equation*.  New  York:  Interscience,  1965. 

[4]  A,  B.  Vasileva,  “Asymptotic  behavior  of  solutions  to  certain 
problems  involving  nonlinear  differential  equations  containing  a 
small  parameter  multiplying  the  highest  derivatives,”  Russ. 
Math.,  vol.  18.  no.  3,  pp.  13-81,  1963. 

[5]  J.  Levin  and  N.  Levinson,  “Singular  perturbation  of  nonlinear 
systems  of  differential  equations  and  an  associated  boundary 
layer  equation,”  J.  Rational  Mech.  Anal.,  vol.  3,  pp.  247-270, 
1954. 

[6]  F.  C.  Hoppensteadt,  “Singular  perturbations  on  the  infinite 
interval,'’  Tran*.  Amer.  Math.  Soe.,  vol.  123,  no.  2,  pp.  521- 
535,  1966. 

[7]  P.  Sannuti  and  P.  Kokotovi£,  “Near-optimum  design  of  linear 
systems  by  a  singular  perturbation  method,”  IEEE  Trans. 
Automat.  Contr.,  vol.  AC-14,  pp.  15-22,  Feb.  1969. 

(8|  R.  E.  Kalman,  “Contributions  to  the  theory  of  optimal  con¬ 
trol,”  Bol.  Soe.  Math.,  pp.  102-119,  1960. 

[9|  M.  Van  Dyke,  Perturbation  Methods  in  Fluid  Mechanics. 
New  York:  Academic  Press,  1964. 

[10)  B.  D.  O.  Anderson  and  J.  B.  Moore,  Linear  Optimal  Control. 
Englewood  Cliffs,  N.  J.:  Prentice-Hall,  1971. 

[Ill  W.  Hahn,  Stability  of  Motion.  New  York:  Springer,  1967. 

[12]  W.  A.  Coppel,  Stability  and  Aiymptotic  Behaoior  of  Differential 
Equation*.  Boston,  Mass.:  Heath,  1965. 

[131  T.  R.  Blackburn,  “Solution  of  the  algebraic  matrix  Riccati 
equation  via  Newton-Raphson  iteration,”  1968  Joint  Auto¬ 
matic  Control  Conf.,  Preprints,  pp.  940-945. 

[141  R.  Bellman,  Introduction  to  Matrix  Analysis.  New  York: 
McGraw-Hill,  1960. 

[15]  W.  A.  Porter,  “On  the  matrix  Riccati  equation,”  IEEE  Tran*. 
Automat.  Contr.  (Short  Papers),  vol.  AC-12,  pp.  746-749,  Dec. 
1967. 

[I6J  R.  E.  Kalman,  Y.  C.  Ho,  and  K.  S.  Narendra,  “Control¬ 
lability  of  linear  dynamical  systems,”  in  Contribution*  to 
Differential  Equation*,  vol.  1.  New  York:  Wiley,  1961. 


A  Decomposition  of  NeRT-Optimum  Regulators  for 
Systems  with  Slow  aod  Fait  Modes 

J.  H.  CHOW.  MEMsaa.  mo,  and  P.  V.  KOKOTOVIC 


However  the  separation  in  [J]  was  not  complete  tince  the  liow  regulator 
design  depended  on  the  fast  feedback  gain  matrix. 

This  short  paper  presents  s  new  procedure  for  s  complete  separation 
of  slow  and  faat  regulator  dasigns  Furthermore  the  performance 
achieved  by  the  composition  of  a  slow  and  a  faat  regulator  proposed  hare 
is  s  second-order  approximation  of  the  optimal  performance.  It  it 
significant  that,  in  contrast  to  previous  dasigns,  this  Mar-optimal  regula¬ 
tor  does  not  require  the  knowledge  of  the  singular  perturbation  parame¬ 
ter  p.  Hence  this  regulator  is  applicable  to  systems  where  p  repreeents 
small  uncertain  parameters.  In  addition  to  the  presentation  of  these  new 
results,  another  purpoee  of  this  short  paper  is  to  give  a  self-contained 
development  of  the  two-time  scale  method  based  on  singular  perturba¬ 
tions  [8}— { 10].  The  paper  eesamee  only  the  knowledge  of  standard  facts 
of  linear  control  theory.  No  familiarity  with  the  singular  perturbation 
literature  is  required. 

fi.  Slow  and  Fast  Subsystems 
We  consider  s  singularly  perturbed  linear  time- invariant  system 

x,-,4„jc,+d|3X2+8,u,  x,(0)-xlo  (la) 

fix, +  + 8,«i,  xj(0)- xjo  (lb) 

y“C1xl  +  C2x1  (lc) 

where  p  is  a  small  positive  scalar,  the  stale  x  is  formed  by  the  n,  and  n2 
vectors  xt.x*  the  control  u  is  an  m  vector  and  the  output  yak  vector. 
As  shown  in  [11],  system  (1)  possesses  a  two-time-scale  property,  that  is, 
it  has  n,  small  eigenvalues  of  magnitude  0(1)  and  n,  large  eigenvalues  of 
magnitude  Ofl/y).  Preliminary  to  a  separation  of  slow  and  faat  designs, 
system  (1)  is  approximately  decomposed  into  a  slow  subsystem  with  «i, 
smell  eigenvalues  and  a  fast  subsystem  with  n2  large  eigenvalues.  In  an 
asymptotically  stable  system  the  feet  modes  corresponding  to  the  large 
eigenvalues  an  important  only  during  s  short  initial  period.  After  that 
period  they  are  negligible  end  the  behavior  of  the  system  can  be 
described  by  iu  slow  modes.  Neglecting  the  feat  modes  is  equivalent  to 
assuming  that  thsy  are  infinitely  rest,  that  it  letting  p-U)  in  (I).  Without 
the  fast  modes  tbs  system  (1)  reduces  to 

x1-4,,x,+/ti2x2  +  81ii,  x,(0)»x„  (2a) 

0>d2|X,+d22x2-*-82u  (2b) 

y  -  C,x,  +  C2x2  (2c) 

where  a  bar  indicates  that  y-0.  Assuming  that  An  is  nrinringular,  we 
express  x2  as 

x2«  — ^22i(,42|X|  +  82u)  (3) 


and,  substituting  it  into  (2),  ws  define  the  slow  subsystem  of  (1)  as 

*,mAo*,  +  Bgu„  x,(0)-xl0  (4a) 

y,  -  CqX,  -l-  DgU,  (4b) 


where 


i 


i 


i 


I 


i 

! 
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1.  Introduction 

Linear  time-invariant  models  of  many  physical  systems  contain  slow 
and  fast  modes.  Control  problems  for  such  models  are  often  ifi-condi- 
boned  end  have  motivated  several  model-simplification  approaches. 
Simplified  models  obtained  via  aggregation  [I]  and  dominant  modes  (2V, 
[3]  approaches  neglect  fast  modes  and  some  of  the  poorly  controllable 
and  observable  slow  inodes.  In  tbs  singular  perturbation  method  (4J.  (3) 
both  slow  and  fast  modes  are  retained,  but  analysis  and  design  problems 
are  solved  in  two  states,  first  for  the  fast  and  then  for  the  alow  modes. 


*0”*l-'4|2‘<  22**1 

Cq*  C,  —  C2d22^2j,  Oq*  —  C24j2'32. 

Thus  x,  »x,,y  -y,,  and  x2  are  the  slow  pans  of  the  corresponding 
variablss  in  (1). 

To  derive  the  fast  subsystem,  we  assume  that  the  slow  variables  arc 
constant  during  fast  transients,  that  is,  x2-0  and  x,-x,» constant 
From  (lb)  and  (3),  we  then  obtain 

M(J'2-*i)“da(x2-x2)  +  82(u-«,).  (5) 


i: 
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Letting  x^texj-xj,  i^-ii-e,,  yy»y-y(,  the  fast  subsystem  of  (1)  is 
defined  u 

pxfmA12xf+B}uf,  xf(  0)-x]0-x2(0)  (6a) 

y,m  C^Xf.  (6b) 
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Suppose  now  that  u ,mG0x,  tad  vy-GjX,  are  designed  such  that  x, 
aad  xf  meet  soma  specifications.  la  view  of 

Tj*  B2Gq )xf  (7) 

which  follows  from  (3),  the  “composite  control’* 

+  Gyx,  +  G^Xf  (8) 

caa  ha  rewritten  u 

"f m  [(/+ )Go*  Gy*5‘Ati  ]x, 

*  ^t[  "^a*(^ti  *  *f]*  (9) 

The  following  lemma  establishes  properties  of  the  feedback  system  (I) 
with  a  compoeite  control  of  the  form  (9),  hot  with  x,  replacing  x,  aad  x. 


replacing  xj+xy. 

Ltmma  t 

If  the  controls 

“.“Gpx, 

(10a) 

UfmG2x, 

(10b) 

«“[(/+  G2 A^B2  )G0+  Gj^^'AjiIx,  +  GjXj 

(ID 

are  applied  to  systems  (4),  (6),  and  (I).  respectively,  and  if  /tu  +  B2G2  is 
stable,  then 

x,(r)-x,(/)+0 (p)  02a) 

xi(r)«  -  A£'(A2X  +  82Go)x,(t)+ Xf(t)+Q(  ?)  02b) 

uU)mu,U)+UfU)+0(ii)  (12c) 

pU)my,U)*y/U)*(Kp)  (I2d) 


hold  for  all  finite  t  >0.  If  At+  B0G0  is  also  stable,  then  (12aHi2d)  hold 
for  all  r€(0,  oo) 

Proof:  The  feedback  system  (1),  (11)  is 


*i 


Au +  B\  (/+■  G2A£>B1)Gq  +  BlG2A£tA 2,  A,2  +  S,G2 
(A&  +  B2 G2  +■  B2Gq  )/p  (^js^  B2G2 )/ ft 


* i 


03) 


Following  [1 1],  we  construct  a  transformation 


1,-pHL  -/iff 

L  /, 


pH 

l2-pUf 


(14) 


where  f,  and  l2  are  n,  xn,  and  n2xn2  identity  matrices,  respectively, 
and 

f.-/lii1(4,1  +  «,C())  +  /UV  (15a) 

H w(Ajj+  B2G2 )  ^nl(4n  +  9iCo)(^#^®t^t^^  ^  (15b) 
/f-(Al2  +  B,G2)(Aa  +  BjG2  r’+0(  n).  <15c) 


Neglecting  the  0(  a1)  terms,  we  obtain 


T&T- 


'f*o 

0 


0 


(16) 


where  £  is  the  system  matrix  of  (13).  G0*(A0+  B0G^-p(A tJ  + 
6|Gj)rf.  and  8i“(4n+8]C2)"/ii(il|i+9|6j).  If  A^^  B2G2  is  sta¬ 
ble.  the  solution  of  (13)  is  approximated  for  all  finite  t  >  0  by 


xl(t)-expJ(A#-*-60G*)flx,(0)+<XM)  (17a) 

x2(t)m  ~i^al(4j|  +  9jG0 )sspl(^5+  BqGq )t lx,(0) 

♦  expl ( An*  B2G2  )i/ u]x/(0) -s-fK  ja)  07b) 


•here  x,(0).  x^O)  are  given  by  (4a),  (6a).  Note  that  the  effects  of  the 


continuous  perturbations  of  the  matrices  in  (I3HI6)  are  incorporated  in 
the  0(/t)  terms  in  (17).  If  in  addition  A0+  B0Ga  is  also  stable,  (17)  holds 
for  all  »e[0,  ae).  Then  (12)  follows  directly  from  (17),  (4).  and  (6). 

Lemma  1  suggests  that  G0  and  G2  be  separately  designed  according  to 
the  slow  and  fast  mode  performance  specifications,  aad  implemented  as 
the  composite  control  defined  by  (11).  This  idea  has  been  applied  to  the 
pole  placement  design  (12).  A  similar  separation  of  designs  is  now 
developed  for  the  optimal  linear  regulator  problem. 

III.  Subsystem  Rboulato*  Pkoblzms 

In  this  section  we  decompose  the  optimum  state  regulator  problem  for 
the  system  (1)  aad  the  performance  index 

Jml  ("(yy  +  u  Ru)*,  R  >0  (1*) 

2  Jo 

into  tiro  subsystem  regulator  problems.  Our  approach  is  to  extract  from 
/  two  quadratic  performance  indices,  one  for  the  variables  of  the  slow 
subsystem  (4),  and  the  other  for  the  variables  of  the  fast  subsystem  (6). 
We  formulate  and  analyze  two  separate  regulator  problems,  denoted  by  s 
for  the  slow,  and  /  for  the  fast  subsystems.  From  the  subsystem  optimal 
controls  u,  and  ty  we  then  form  a  composite  control  uc  •  u,  +  ly  which  is 
to  be  implemented  on  the  original  system  (I).  Its  performance  is 
analyzed  in  the  next  section. 

Probltm  s 

Find  u,  to  minimize 

j^"(y>,  +  sfie,)dr,  II  >0  (19) 

for  the  slow  subsystem  (4). 

In  terms  of  x,  and  ut,  ( 19)  becomes 

J,~^j~[x,CoCoX,  +  2u^DoCoX,  +  u,,R<ttt]dt  (20) 

where  RomR  +  From  [131(141,  we  know  that  if  the  Riccati  equa¬ 

tion 

0-  -  K,  (A0-  W  'OiC0  )-(A0- Bf)Rg  'DiCo )  K, 

*■  K.BoRtT  'BiK,  DoRo'  'Di  )C0  (21) 

has  a  positive  semidefinite  stabilizing  solution  K,,  then  the  optimal 
control  for  (4)  and  (19)  is 

u,  -  -  *<f 1  U>oC0+  BoK,  )x,.  (22) 

A  sufficient  condition  for  the  existence  and  uniqueness  of  K,  is  given  in 
the  following  theorem. 

Theorem  I 

Condition  a:  If  the  triple  (,40.fl0,C0)  is  stabilizable-detectable.  then 
(21)  has  a  unique  positive  semidefinite  stabilizing  solution  K,. 

Proof:  From  [I3|,(J4|,  the  stabilizing  solution  K,  exists  if  the  triple 
(A0~  B0R0~,DoCo.B0.C0)  is  stabilizable-detectable.  where  QC0<»  C&I 
-  DoRf'DQCo.  Note  that  (rf0- BoRf'D^C^Bo)  is  stabilizable  if  and 
only  if  (Ao.Ro)  is  stabilizable.  From  the  well  known1  identity  /- 
DoRo-'Dt-'  -(1  +  DaRD^~'  >0  which  holds  when  R  >0,  it  follows  that 
there  exists  a  nonsingular  Q0  such  that  QoQom  'D'o  Hence 

(Ao~  B0Ro~  'OjCo,  Q0Co)  is  detecwble  if  and  only  if  (AyC<J  is  detect¬ 
able.  This  proves  that  the  stabilizability-detectability  of  the  triple  (A0~ 
BoRo~'DoC>Bo.Ca) IS  equivalent  to  Condiuon  a. 

Probltm  j 

Find  Uf  to  minimize 

//- jJ^*(y///+u>Ruf)<*  (23) 

for  the  fast  subsystem  (6). 


'Sw.  for  tuapte  (I).  pp.  190-191) 


smn  patiu 

It  it  well  known  that  the  optimal  control  for  (6),  (23)  it 

Ufm-R-'BiKfXf  (24) 

where  Kf  it  the  potiuve  semidefimte  stabilizing  solution  of  the  Riecati 
equation 

0*  —  KfA}2~ KfByR  CjCj.  (23) 

Conditio*  b:  This  solution  exists  and  it  unique  if  the  triple  (A  y,  Bv  Cj) 
it  stabilizable-detectable. 

The  controls  u,  and  t *f  defined  by  (22)  and  (24)  are  only  subsystem 
optimal.  It  it  much  easier  to  compute  u,  and  Uf  than  the  optimal  control 
for  the  complete  system  (I).  Lemma  1  indicated  how  a  composite  control 
e,*i^+i if  can  be  obtained  in  terms  of  x,  and  Xj.  It  it  of  interest  to 
investigate  the  performance  of  the  system  (1)  controlled  by  a,.  With 
G0-  - &o~'(DoCa+ BiK,)  and  C2-  -  A  ~'B2Kp  the  composite  feed* 
back  control  (11)  it 

■♦*  R  “  }|  jxj  •  R  ~  (26) 

The  complete  separation  property  of  the  composite  control  (26)  lies  in 
the  fact  that  the  Conditions  a  and  b  are  mutually  independent  This 
contrasts  the  conditions  in  (5},(8|  where  the  existence  of  the  solution  for 
the  slow  regulator  problem  depended  on  Kp 
Another  practically  important  property  of  the  control  law  (26)  it  that 
it  does  not  explicitly  depend  on  p.  It  is  now  shown  that  even  without  the 
knowtedgs  of  p.  the  control  (26)  results  in  an  0(  p2)  approximation  of  the 
optimal  performance  index. 

IV.  NiAa-OrTtMAUTr  or  the  Composite  Conteol 

For  a  comparison  with  the  exact  optimal  control,  we  express  ut  in  a 
more  convenient  form.  Since  Aa~  B2R  ~  'B2K,  is  nonsingular,  manipu¬ 
lation  of  the  expression  R 0  using  (23)  yields  the  identity 

-  R  - '[/+  B{(AU- B2R  -  'BiKf  )"  'A^A  *'  ]  (27) 

and  hence  (26)  can  be  rewritten  as 
ec  «  -  R  ~ 1  (  Bj  K,x,  +  BjK^x,  *  ByKfXy) 

m-R-'B’  K’  °„  x--R-'B'Mcx  (26) 
pKm  pKf 

when  ,  x'*(x'txi).  and 

-  [  A,  (B,  R  -  'BiKf- A  „)  -  UvKf+  CJC, )  ](Aa  -  BtR  “  'B{K,  ) *' '. 

(29) 

On  the  other  hand  the  exact  optimal  control  for  the  complete  problem 
(I),  (IS)  is  ~R~  'B'Kx,  where  K  is  the  stabilizing  solution  of  the 
Riccau  equation 

0--KA -AK+KSK-CC  (30) 

with  C-(C,C,J.  S-BR-'B\  and 


The  expression  (30)  defines  an  implicit  dependence  K  ( pi  of  K  on  the 
parameter  p.  Our  objective  is  to  analyze  the  relationship  between  K(  p) 
and  M,  in  (26)  for  p  small  and  positive.  For  this  purpose  we  construct  a 
power  series  expansion  of  K(  p). 


Theorem  2 

If  the  Conditions  a  and  b  are  satisfied,  then  the  positive  lemidsfanta 
stabilizing  solution  A»  A(p)  of  (30)  possesses  a  power  series  expansion 
at  p-0.  that  is. 


*!  P*l' 

♦  2  £ 

'  Kl° 

pA5t° 

it,  1! 

,pxr 

pKi‘\ 

Furthermore,  the  matrices  Kt,KpKy  satisfy  the  identities 

AT, -A,,  KjmKm,  Kf  (32) 

where  K,,  Kp  and  Km  are  defined  by  (21),  (23),  and  (29),  respectively. 
Proof:  The  substitution  of  (31)  into  (30)  yields  at  p-0  the  equaboos 

0--AT,  (A||“J|jAj)*(A||  —  ^ijATj  K\  +  AT|3j  AT, 

"  A.jAn  ■  A  ATjSjAj*  C[Cj  (33a) 

0*  ATj  (SjATj  —  Aa)  —  KtA  ,j— A’uKy  +  KxS\iKi  —  C,Cj  (33b) 

0-  -  KyAn- A'nK,+ K3StK}- qc,  (33c) 

where  S, -  S2  -  BjR  ~'B±.  and  Stl~BxR~'Bt-  Under  Condi¬ 

tion  b,  (23)  and  (33c)  imply  that  ATt»  Kr  Hence  (33b)  can  be  solved  for 
K2  and  substituted  into  (33a).  This  results  in  the  Riecati  equation 

0-  -  KXA-AKX  *KXBR-  *B'KX  -  CC  (34) 

where 

A  •  AqAq  1  DqCq  (33a) 

BR-'B’mB^'Bi  (33b) 

CC-Ci(l-D0R<r'Di)Ca.  (35c) 

The  derivation  of  (34),  (33)  involves  simple  but  lengthy  calculations 
which  are  found  in  (6).  Under  Condition  a.  (21)  and  (34)  imply  that 
AT,  -  K,.  Hence  from  (29)  and  (33b),  K2  ~  Km-  The  exisience  of  the  series 
(31)  then  follows  from  the  implicit  function  theorem  (6). 

When  the  linear  singularly  perturbed  regulator  problem  was  treated  in 
(51,(81,  the  fast  regulator  (33c)  was  designed  first  and  only  then  the  slow 
regulator  (33a).  We  point  out  that  in  [31(8],  it  .was  unclear  whether  the 
stabilizabUity-detectsibility  of  the  triple  (A,B,C)  depended  on  Kp  since 
there  A,  B,  and  C  appeared  as  explicit  functions  of  Kp  This  question  is 
now  answered  by  Theorem  2.  which  results  in  the  separation  of  designs 
of  X,  and  Kp 

Theorem  2  establishes  that  the  composite  feedback  control  uc  in  (26)  is 
0(  p)  close  to  Mgp,.  This  implies  that  Jc,  the  value  of  the  performance 
index  J  of  system  (1)  with  ut,  is  at  least  0(p)  dose  to  the  value  of  the 
optimal  performance  index  The  following  analysis  of  Jc  and 
reveals  that  ur  in  fact  yields  an  0(  p2)  approximation  of  J^. 

Since  Jm  m  jX^Axg  and  Jc  •  J  x'pP^  where  Pr  is  the  positive  definite 
solution  of  the  Lyapunov  equation 

P' ( A  -SM')  +  (A- SMe YP' -  - M;SMe -CC  (36) 

the  following  theorem  holds. 

Thtortm  3 

The  first  two  terms  of  the  power  series  of  Jc  and  Jm  at  p—0  are  the 
same,  that  is, 

0C#a»)  (37) 

and  hence  the  composite  feedback  control  (26)  is  an  (Kp2)  near-optimal 
solution  to  the  complete  regulator  problem  (!),(18). 

Proof:  Adding  (30)  to  (36)  and  rearranging,  we  obtain  a  Lyapunov 
equation  for  Pe-  W\ 

W  ( A  -  SMt )  +  ( A  -  SMt )'  W  4  ( AT  -  Af,' ) S  (  X  -  Mc )  -  0.  (38 ) 

By  an  application  of  the  implicit  function  theorem  to  (36)  ire  can  show 


that  te  possesses  a  power  series  at  p-O.  Thus  W  can  also  be  expanded 
as  follows: 
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Mi  2+  V1An+AaViHKm-KrysiKf-Q  (49b) 

A^V,  +  K/SJK/mQ  (49c) 


y  £\  W I •'  p»T> 

,r0  <!  [  M»r  w' 


(39) 


From  (18).  (31).  and  (32)  we  have  (*- M;)S(K- Mc)-0( p2)  and.  since 
the  ma these  Aq —  BqRq  '( DqCq  BqX,)  and  -4 22  ~  S2R  are  stable, 

the  substitution  of  (39)  into  (38)  yield*  and  H',1,-0,y- 1.2,3. 

Hence  ifwOCp2),  which  proves  (37). 

We  have  therefore  shown  that  the  composite  control  (26).  even  though 
it  does  not  contain  p  explicitly,  guarantees  an  0(  p2)  approximation  of 
the  optimal  performance.  Thus  this  design  eliminates  the  need  to  know 
p,  required  in  previous  designs  (3),  (8]  for  a  second-order  approximation. 
At  before  p  would  be  needed  for  a  higher  order  approximation  which  is 
not  considered  here. 


where 

/4||«/4n-S|X'1-S,2/fr'  (50a) 

An "  —  ^12^1  ~  BjK,.  (50b) 

Since  Au  is  stable,  there  exists  a  unique  positive  senudefiniie  solution 
Vl  of  (49c).  Expressing  V2  in  terms  of  V,  and  V3  and  substituting  into 
(49a),  we  obtain  from  (49c) 

V\  {jtll-AllA^tAJt)*^A  II~'4|2'422I-4ji)'F, 


V.  Reduced  Control 

Now  we  consider  the  approximation  achieved  by  optimizing  only  the 
slow  subsystem. 

If  Wf- Cjjty  is  designed  such  that  Aa  +  B2G2  is  stable,  from  (II).  the 
control  optimizing  the  slow  subsystem  is 

v •  -[(/ f  )8j" 1  (OgCj+  BqKj  )  —  GyA 22*^21  ]jt|  +  G2x2. 

(40) 

In  particular,  if  Aa  is  stable  and  C2-0,  then  (40)  becomes  the  “reduced 
control" 

ur-~R1t-'{DiC0+BiK,)xl-Fx.  (41) 

The  value  J,  of  the  performance  index  J  with  u,  in  (41)  as  the  feedback  is 
J,~jXqF, jto,  where  P,  is  the  positive  definite  solution  of  the  Lyapunov 
equation 


-  -  (Km  -  K, -  A'uAZ  % )5j  (A.  -  K,  -  A\tA’£  %  )  (5 1 ) 

Rearrangement  of  (45)  yields 

Km- Kr- AuAn'Kf-0  (52) 

and  hence  the  right-hand  side  of  (51)  is  identically  zero.  Furthermore 
Au  —  A  12^22 “  ^o~  Mo‘  '(2>6C0  +  BqK,).  which  is  stable.  Thus  the 
solution  (51)  is  F,  -0  implying  Vm  0(  p)  and  (43). 

Comparing  Theorem  4  to  Theorem  3.  it  is  obvious  that  the  major 
portion  of  J  is  contributed  by  the  slow  subsystem,  while  the  contribution 
of  the  fast  subsystem  is  0(  p).  Another  inference  from  Theorem  4  is  the 
insensitivity  of  the  slow  subsystem  to  change  in  the  fast  subsystem, 
provided  that  A „.  Bq,  Cq.  and  D0  remain  unchanged.  Frequently  only  the 
slow  subsystem  is  modeled.  For  changes  in  the  fast  subsystem  that  do 
not  affect  Aq.  Bq.  Cq,  and  Dq,  the  feedback  control  (41)  remains  near-op¬ 
timal. 


Pr(A-BF)+(A-BF)P,m-FR-'F-CC. 


(42) 


Even  though  u,  in  (41)  11  not  0(  p)  dose  to  its  performance  J,  does 
approximate  J ^  to  0(  p)  order. 

Thtonm  4 

If  An  “  stahle.  then  the  constant  terms  of  the  power  series  of  J ,  and 
at  p-0  are  equaL  that  is. 


y,-/«^+o(p) 


(43) 


and  hence  the  feedback  control  u,  in  (41)  is  an  0(  p)  near-optimal 
solution  to  the  complete  regulator  problem  ( 1 ),  ( 18). 

Proof:  Using  (25)  and  (27),  u.  in  (41)  can  be  expressed  as 


1 ^m-R-'B' 


K,  0 

K ;  0 


x--R-'B'Mrx 


(44) 


where 


Vm 


v\n  P» V 

!  I  nVl*  nty) 


VI.  Design  Procedure  and  Example 

Summarizing  the  preceding  sections,  we  propose  the  following  design 
procedure. 

For  an  0(  p2)  near-optimum  regulator  solve  (21)  for  K,  and  (25)  for  Kf. 
The  composite  control  to  be  implemented  is  given  by  (26). 

For  an  0(p)  near-optimum  regulator  when  Au  is  stable  solve  (21)  for 
K,  and  implement  the  reduced  control  given  by  (41). 

As  an  illustration  we  consider  a  system  with  fast  and  slow  modes  in 


8;-[R.  +  (RfS1j-Ai,)Aa  '*)][/+$, (A^-SyK, )’-'*>].  (45) 

Hence  (42)  can  be  rewritten  as 

P, ( A  -  SM, ) +  (A  -  SM, yr, m  -  M,SM, -CC  (46) 

and  P,  possesses  a  power  series  in  p.  Adding  (30)  to  (46)  and  rearrang¬ 
ing,  we  obtain  a  Lyapunov  equation  for  P,-  K~  V 

V(A  -SM,)  +  (A-  SM, )‘  V+(K- M;  )S(K-M,)m0.  (47) 

Substituting  the  power  series 

r,  pK, 


(1), 

•4|i“ 

[S 

0.4] 

o  J' 

*  J21 

-4  21  "  j 

[: 

-0.524] 

o  J' 

*22 

o  o 

• 

By 

c,- 

'  1 
.0 

1} 

Cl 

0  0 
0.345  0 

-0.465 


-Cl 

-[!  S! 


.r] 


Let  the  performance  index  be 

J  m  i  f’l/y  +  llil)* 
2  Jn 


(53a) 

(53b) 

(53c) 

(54) 


(48) 


4*2 

into  (47)  and  evaluating  at  p-0  yields 

Mi|4-dj,F,+  M„-l-di,Kj+(RM-A;)J1(AM-8;)'-0  (49a) 


Conditions  a  and  b  are  satisfied.  Solving  problems  s  and  /.  the  composite 
control  (26)  is 

ur-(-l  -0.86l23lx,+[ -0.18036  -0.046l87lxj  (55) 

whereas  the  reduced  control  (41)  is 

pr-[ -0.87122  -0.57325 lx,.  (56) 

For  p-0.1.  the  optimal  feedback  solution  is 

p^-l-1  -  0.89202)x,+[ -0.24396  -  0.06I996)x2.  (57) 

For  the  initial  condition  xj-(I.O. 1.0).  the  values  of  the  performance 


I 

] 

I 

I 


umm 


SNOtT  RAMStS 

index  ire 

-4.2406 

I3l>u  j 

y  -4.2428 

i  -st.l 

/,  *4.2306. 

(5Sci 

Hence  (he  (rf.'rmame  loi>.\  with  ut  is  less  than  0.052  percent  anti  with  u. 
leu  then  0.:-'  ;■  -trert. 


\  I :  Conclusion 

The  proposed  leJuced  anu  composite  Feedback  controls  are  inuepcn- 
dent  of  ft  and  vet  achieve,  respectively.  0(  ft)  and  0(  n:)  approximations 
of  optimal  performance.  I  he  new  existence  Conditions  a  and  b  a-e 
mutually  indcpet.'ieui  an.)  eV.ihli-K  :.he  Complete  separatum  of  slow  and 
fast  regulator  designs,  the  implementation  of  the  regulators  uoolves 
solving  lower  order  muti.  i independent  Riccati  equations.  Th:se  re¬ 
sults  make  the  itesigr  '  linear  regulators  for  singularly  perturbed  sys¬ 
tems  considerably  siirpier  han  in  (5|,|8|  and  applicable  to  systi  ms  with 
small  unmeasurable  p.ratnt  ters. 
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Note  on  Singular  Perturbation  of 
Linear  State  Regulators 

Abxtrmct — This  correspondence  examines  the  relationship  betwtea  the 
remits  obtained  whea  the  tlminsicMHty  of  ■  regulator  problem  is  reduced 
la  the  statement  of  the  problem  aad  when  thh  redaction  h  made  la  the  Riccati 
•qnation  foe  the  aoaredaetd  problem. 


condition!  ere  given1  such  that  when  a  —  0*.  then 

Vf«[t0,t>]  (i«) 

£, -/C2  JC,  —  Xj.  Vt  e  [to.  <  j]  (5b) 

where  r2  <  if  •*  arbitrarily  close  to  tt.  The  limits  Kt.  K j,  and  K j  are 

obtained  from  a  system  of  one  differential  and  two  algebraic  equations, 

A,  -  -(/C,/d,  4-  A\K,  4-  A\K\  +  KtA}  -I-  Q,)  -t-  SR"N\ 

*,<(,) -fl,  (6a) 

0  -  -|K2<4t  +  KtAj  4-  ^'jKj  4-  Qj)  +  NR-'B'jKj  tbb) 

0  —  -(Kjl.  4-  A.K  j  +  Qj)  4-  Kjtjt  iB'iKy  (6c) 

where  N  •  K,B,  +  K2B2,  and  /C,  is  the  positive  deffnite  root  of  (6c) 
Under  the  same  conditions,  when  1  —  0*  then 

a  -  5  -  - R*  ‘(Afx  4-  SjKjt).  Vt  e  [r».  r2].  (7) 

In  the  approach*  it  is  essential  that  the  limiting  process  i  -  0*  is  performed 
in  the  Riccati  equation  for  R.  The  purpose  of  this  correspondence  is  to 
analyze  the  relationship  between  the  limits  (5)  and  (7),  and  the  solution 
of  the  “reduced"  problem 


i  -  Axi  4-  4j*  4-  B, A. 

«(to)  -  x° 

(8a) 

0  —  y4jj!  4-  /4,f  4-  fl2 A 

(8b) 

y  -  ,.«((,)  4-  i  £'{[r  ;  r][®.‘ 

H*1-ra] 

gJL-‘J  J 

.  dt.  (9) 

This  problem  is  obtained  by  formally  neglecting  a  in  the  original  proW,  m 
(t),  (2)  and  thus  reducing  dimensionality  of  the  state  space  from  n  +•  m  to  n. 

Under  the  conditions  stated1  and  if  A', 1  exists,  the  “reduced"  problem 
(S),  (9)  becomes 

i  -  Ai  4-  /to,  «r0)-x°  UO) 

j  .  ijt’tyjn ,*(,)  4- }  P  [*•$,*  4-  a-R a  -  2*'<?2ca]  dt  < m ) 

•t« 

where 

A  m  Ax  —  fl  -  B,  -  A2A^B2  C  *  A*  lB2 

6,  -  Gt  -  Gi^a"-<j  4.(/4;1r2)'Gj^;U3 

<?2  -  G2  -  ( Al  'AJQ,  A  -  *  4-  C'GjC.  1 1 2) 

The  solution  of  this  problem  is 

A  -  -*'•[*,*  -  $ 2CT*  *  -R-'ffi  (13) 

where  A,  is  obtained  from  the  a  x  n  Riccati  equation 

/j,  «  -(R,^  4-  A'R,  +  0,1  4-  tfR'1#’,  «,(t/l-n,  U41 

where  x.  and  u  are  m-,  and  r -dimensional  vectors,  y  »  [v  •  :  ].  and 
a  is  a  small  positive  parameter.  For  a  >  0  the  optimal  control  is 


is  the  solution  of  an  In  4-  ml  *  In  +  ml  matrix  Riccati  equation.  Sufficient 


Problem  Statement 

Consider  the  optimal  state  regulator  problem 

x  m  .i,.e  +•  ^2j  *  fl|U.  x(r0)  «  x“ 
Xt  -  ^j.x  4-  A,:  *■  Bjii.  rtc0)  -  r° 


(la) 

(lb) 


r  n,  An2]  f*'(  re,  q2i  ) 

1  ^Har,  >.n2 +  iJ  r'k  cJ>  +  uR“JJf  ,2) 
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Equivalence  op  Riccati  Gains 

The  following  result  esublishes  a  relationship  between  the  solutions  of 
(14)  and  (6). 

Lemma  I:  Under  the  conditions  stated1  and  if  a;  1  exists,  then 

*i  “*,•  Vt e [r0, t/J.  (15) 

Proof:  From  (6b)  we  have 

K,  -  (NR- ‘SiK,  -  KtA2  -  A‘3K3  -  <2,M;  (16) 

which  when  substituted  in  (6a)  results  in 

*i  *  -[K.-4  +QX  -  +  PR-'P 

+  Ul'A3)\K3At  +  AtKt  -  KiBlR-,BrJK3]A;lA3  (17) 

where 

P  -  N  -(A:‘A}yKsBt  -  K.B,  +  -  (A;lA3)K3B2.  (18) 

'  P  V  KotuxoviC  and  *.  A.  Y*ck«l.  "Singular  perturbation  ihaory  of  linear  stair 
raBUnm*."  in  fw.  Si*  AMU.  AlUrmt  Coxf.  Circmt  md  Sysltm  TKtxry.  Oct.  1970. 

The  substitution  of  (6c)  in  the  last  term  of  ( 1 7)  and  the  substitution  of  ( 16) 
in  (18)  yield,  respectively. 

It,  -  -[K./l  +  AKX  +  3,]  +  PR"P  (19) 

/>-<,«  +  NR-'BtKyC  -  Q2C 

-(Ai'AffiAtK,  A- K,At)A;'Bt.  (20) 

The  use  of  (6c)  to  replace  the  last  term  of  (20)  reduces  P  to  the  following 
expression 

P  -  K,t  -  QjC  a-  PR-'VjKyC  •  X  A-  PR-'«2K3C.  (21) 

which  implies 

P  •  X(l  ~  R-'B’lK10-'  ±XM.  (22) 

The  expression  for  M  can  be  reduced  further  as  follows  with  the  use  of 
(6c)  so  that 


AT'  -[/  -  R-'BiOCj/t;')®,] 

-  /  -  R-'B,JA;'(KiBJR-'P1K}A;'  -  Q,A ;l  -  K2)fl2 

-  R-'\R  a-  C’QyO  a-  R-'CKyBtd  -  R-'P2K30 


-  R"k  A-  R-'CK3B2M- 

(23) 

which  yields 

M  -  R-‘R(f  -  R-'CK3B2 ) 

-  fi-'WY'R 

(24) 

and  finally 

MR-'M-  -  A'1. 

(25) 

Equivalence  of  Controls 

We  now  establish  the  control  5  defined  by  (7)  and  the  control  6  defined 
by  ( 13)  are  identical  on  the  open  interval  (t0.  (/). 

Lemma  2:  Under  the  conditions  stated*  and  if  A2 '  exists,  then 

a -a,  vi (26| 

where  t,  >  r0  is  arbitrarily  close  to  t„. 

Proof:  Substitute  u  for  u  in  (1)  and  note  that  At  -  B2R-'P2K3  is  a 
stable  matrix  for  all  f*[t0.fj].  Therefore,  by  a  theorem.1  when  *  0* 

then  a 

*  ~(^a  -  BtR-'&iKJ-'iAy  -  B2R-'S')x,  Vf6[r,.t2]  (27) 

and  hence 

■  -*~'[N-  -  P2K3(At  -  B2R-‘P2K3)-‘(A3  -  B2/r‘JV)]x 

A  -Tx.  Vte[f,.r2].  (28) 

This  expression  for  o  is  now  shown  to  be  identical  to  the  expression  (13) 
for  ii.  We  have  from  (28)  the  equality  chain 

T  -  R-'[N’  +  P2K3A;'(I  -  B2R-'P2K3A;l)-'B2R-'N- 
-  b-2k3a:'u  -  b2R'ib'2Kj4;,)-,4j} 

-  R  ' 1  { JV'  +■  B’JKiCMR-'N'  -  RMR~l B’2K}A2' A3) 

-  ! R"  ‘(/  +  B’1K3CMR-')N'  -  MR-,B'1K3Ax,A3) 

-  {R"‘(RMM  +  B'3K 3QM R~ 1 N’  -  MR-'P2K3A;'A3\ 

-  MR-  '(\  -  B2K3Aa  'a3)  mMR  'P  -  MR'1  M  S'  -  A'1#',  |29) 

which  is  identical  to  (13)  and  proves  the  lemma. 

1  !■  Levin  and  N.  Levinson.  "Singular  perturbation  of  nonlinear  systems  of  differential 
equations  and  an  associated  boundary  layer  equation."  J  Ranoxm!  Mtch.  Anal.,  vol.  3. 

1 9)4.  pp.  247-270. 

Concluding  Remarks 

In  practical  design  the  dimensionality  of  the  state  regulator  problem  ( 1 X 
(2)  can  be  reduced  by  neglecting  a  either  in  (1)  and  (2).  or  in  the  Riccati 
equation  for  £.  It  is  shown  in  this  correspondence  that  both  approaches 
result  in  the  same  Riccati  gain  R,  and  that  the  corresponding  controls  u 
and  f>  are  identical  on  the  open  interval  (r0,  if).  A  question  that  needs 
further  clarification  is  under  what  conditions  will  the  application  of  either 
u  or  0  result  in  the  same  limiting  behavior  of  the  system  (1)  as  i.  -♦  0*. 

A.  H.  Haddad 

P.  V.  ICOKOTOVlt 

Dep.  Elec.  Eng. 
Coordinated  Sci.  Lab. 
Univ.  Illinois 
Urbane.  III. 


Consequently  (23).  (22).  and  (19)  yield  the  same  equation  for  K,  u  (14), 
which  proves  the  lemma. 


-tufoMwuru,  Voi.  16.  pp.  211  213 
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Lower  Order  Control  for  Systems 
with  Fast  and  Slow  Modes* 

B.  F.  GARDNER,  jRt  and  J.  B.  CRUZ.  Jr+ 


Key  Word* — Perturbation  techniques;  system  order  reduction;  approximation  theory;  models. 


Abstract— Given  a  stabilizing  control  for  a  linear  system  with 
fast  and  slow  subsystems,  a  lower  order  control  as  a  function 
of  slow  states  alone  is  designed  to  give  a  first-order  approxi¬ 
mation  of  the  original  quadratic  performance  index,  which  is 
not  necessarily  minimized  by  (he  given  stabilizing  full-order 
control. 


1.  Introduction 

Singular  perturbation  theory  for  linear  regulators  is  well 
known  tKokolovic.  O'Malley  and  Sannuti.  1976;  Haddad  and 
Kokotovic.  1971:  Chow  and  Kokotovic.  1976;  Kokotovic  and 
Haddad.  1975).  However,  in  all  cases  the  objective  has  been 
to  design  a  suboptimal  control  to  approximate  some  charac¬ 
teristic  of  the  system  due  to  an  optimal  control.  This  paper 
extends  the  linear  regulator  theory  to  the  case  of  designing  a 
control  with  partial  state  feedback  to  approximate  the  perfor¬ 
mance  cost  of  a  given  full  state  feedback  control.  The  given 
control  need  not  be  optimal  as  was  the  case  in  (Chow  and 
Kokotovic.  1976)  and  the  reduced  control  is  based  on  both 
fast  and  slow  subsystems  which  is  not  the  case  with  the 
reduced  control  in  (Chow  and  Kokotovic.  1976).  Reduced 
order  controls  do  not  necessarily  lead  to  well-posed  for¬ 
mulations  (Gardner  and  Cruz.  197$)  so  that  the  study  of  the 
asymptotic  behavior  of  reduced  controls  is  important. 


2.  Slow  and  last  subsystems 

Consider  a  singularly  perturbed  linear  time-invariant 
system 

x,  =.4, , x,  +  .4,  2x2  i-  B,u;  x,(Ol  =  x10  Ha) 

)1X,=  l,,x,  +  422x2  +  fl2u:  x,(0)  =  x:o  lib) 


We  assume  that  we  have  a  control  as  a  feedback  function 
of  x,  and  x2  which  we  will  apply  to  equation  II).  This  control 

is 

U-G,X,  +G2X2.  (21 

It  is  necessary  that  this  control  results  in  a  stable  system 
when  applied  to  equation  (I).  G,  and  G,  which  result  in  a 
stable  feedback  system  are  not  guaranteed  to  exist.  However. 
(Chow  and  Kokotovic.  1976)  gives  conditions  under  which 
they  can  be  designed  from  fast  and  slow  subsystems  perfor¬ 
mance  specifications.  In  this  paper  we  assume  that  G,  and  G, 
are  given.  Substituting  equation  l2>  into  equation  ( 1 ).  we  find 
the  slow  subsystem  by  neglecting  the  fast  modes  of  equation 
Ilk  that  is  letting  /i»0  in  equation  (1).  This  gives,  assuming 
422  a-  B2G2  is  nonsingular, 

x2 *  —  [A22  +  ^2^2]  ‘Mj.+BjG,]*,  (3) 

where  the  bar  indicates  that  p*0.  If  equation  (3)  is  sub¬ 
stituted  into  equation  |  la)  we  get  the  slow  subsystem 

x,  =  /lex,;  x,(0)»x10  (41 

where 

•4o  “.4 1 1  +  B,  G,  —  [  4, .  +  B|G2][422  —  B2G2]  '[-^i  +  B2G,]. 

To  find  the  fast  subsystem  of  equation  1 1 )  we  assume  that 
the  slow  variables  are  constant  during  the  fast  transients,  that 
is.  i,=0  and  x,  =x,  =  constant.  Then  from  equations  (lb)  and 
(3)  we  have 

j<<x2-x2)  =  (.-l22  +  B2G2  Mx2 -x2  I-  (5  i 

Letting  x/»x2-x2.  the  fast  subsystem  of  equation  ll)  is 


where  p  is  a  small  positive  scalar,  x,  and  x2  and  n,  and  n2 
dimension  vectors  respectively  and  u  is  an  m  dimension 
sector.  The  matrices  have  appropriate  dimension.  It  has  been 
shown  (Kokotovic  and  Haddad.  1975)  that  system  equation 
III  has  n,  slow  eigenvalues  and  n,  fast  eigenvalues  of  order 
OH)  and  ll.pl  respectively.  The  usual  approach  to  the  appro¬ 
ximate  design  of  a  control  is  to  decompose  the  system 
equation  (1)  into  fast'  and  'slow'  subsystems.  The  fast  sub¬ 
system  approximately  models  the  behavior  of  the  fast  modes 
of  equation  ( I )  and  the  slow  subsystem  approximately  models 
the  slow  modes.  This  decomposition  is  well  known  (Chow 
and  Kokotovic.  1976)  and  it  is  outlined  below. 
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pit,  =*[422-t-fl2G2]x/.;  x/(0)-x2o-x:l0l.  (61 

The  slow  and  fast  modes  of  equation  (1)  when  equation  |2) 
is  applied  are  approximated  by  equation  |4)  and  equation  161 
respectively. 


3.  Approximate  control  formulation 
ll  is  desired  to  find  a  control  as  a  function  of  x,  only  which 
yields  a  close  approximation  of  the  performance  of  that  of  (he 
control  as  a  function  of  x,  and  x,  equation  |2)  when  applied 
to  system  equation  (I).  To  compare  the  performance  of  the 
two  controls  we  select  the  quadratic  performance  index 


where 


J  =  1  j  [x  Qx  +  u  Ru]d( 


(71 


qjg, 

L<?2 

Q J 

:;} 

We  define  the  noiation 

A  =. 

‘^t  t 

in 

•4,7 

422 

B 

P  _ 

{«%]■ 
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Then,  if  the  feedback  control  equation  (2)  is  applied  to 
equation  (I)  for  performance  index  equation  (7)  a  cost  results 
which  we  denote  by 

J-lx0Px  o  |8> 

where  P  is  the  positive  semidefinite  solution  of  the  Lyapunov 
equation 

P\At  8[G,  i  Oj]J  4-  )A  4-B[G, :  Jf?[G, :  G2] 

(9| 

The  system  and  performance  index:  equations  (1),  (7)  are  of 
interest  only  if  the  control  of  equation  (2)  is  stabilizing.  That 
is.  if  the  feedback  matrix  when  equation  (2)  is  applied  to 
equation  (1)  is  not  stable,  then  the  cost  is  infinite  and  is  of  no 
interest.  Hence,  we  assume  that  equation  (2)  is  stabilizing,  in 
which  case  A  +  B[G,  j  G,]  is  stable.  Moreover. 

Q-[^;]RtG,;G2]gO. 

Thus,  there  exists  a  unique  positive  semidefinite  solution  to 
equation  (9).  Note,  however  that  since  A  and  8  contain  n. 
equation  (9)  is  numerically  'stiff'. 

Theorem  1.  If  the  fast  state  feedback  matrix  [422  +  fl:G:J 
and  the  slow  slate  feedback  matrix  ,40  are  stable,  then  P 
possesses  a  power  series  expansion  at  /j  =  0.  that  is 


P1,11  can  be  found  from  equation  1 1 3bl  and  substituted  into 
equation  (13a)  to  give 

P‘,"Ao  +  AoP‘l"  +  i-0  (14) 

where  is  some  known  matrix.  Thus,  if  A„  is  stable  equation 
(14)  possesses  a  unique  solution.  Higher  order  terms  follow  in 
a  similar  manner.  Thus.  Theorem  1  is  proved. 

We  now  desire  to  approximate  the  control  equation  (2)  by 
a  control  which  is  a  function  of  x,  only.  To  do  this  we 
substitute  equation  (3)  for  x2  in  equation  (2)  to  give  our 
reduced  control 

a,-;G1-G2[422  +  B2G2]-|[-4ti+82G,]!x1  (15) 

»Sx,. 

For  ii  sufficiently  small,  the  eigenvalues  of  the  system  using 
this  reduced  control  are  close  to  the  eigenvalues  of  40  and 
422  [4],  If  equation  (15)  is  applied  to  equation  (I)  for  the 
performance  index  in  equation  (7)  the  resulting  cost  is 

J’afxorx,,  1 16) 

where  T  satisfies 

r ;  .4  t  B[s ;  o] ;  + ;  a  +  s[s-;  o] ;  r + q  *  jp[s ;  oj  -o. 

(17) 

If  4  BC S ■  03  is  stable  then  equation  (17)  possesses  a  unique 
positive  semidefinite  solution.  If  l0,  4,,.  and  4,,  -r-  B.G,  are 
stable,  then  for  sufficiently  small  it.  ,4  *■  8[S-0]  is  stable. 


Proof.  The  proof  consists  of  showing  that  each  term  in  the 
series  expansion  of  P  exists  and  is  unique.  Then,  clearly,  there 
is  a  it*  >0  small  enough  to  guarantee  convergence  of  the 
series  for  all  0<p<p*. 

The  substitution  of  equation  (10)  into  equation  (9)  at  ;i  =  0 
yields 

0=“P|[,4n  4- B, G|]  +  P.[.421  +  82G,]  +  [.4, ,  +B|G,]'P, 

■+•  C 4 2 ,  4-B20|]'P'2  4-Q,  +-G|RG|  (1  la) 

0-P.[4t2  +  BtG2]  4-P  2[4224-B,G2] 

-*-[42|  4-B2G,]'Pj +  G|PG2  (lib) 

0  =»  Pj[422  4-  B2G23  4*  22  4*  82G2J'Pj  4-Q2  4-  G2PG2  (1  let 

If  [422  4-B,G2]  is  stable  equation  I'lc)  possesses  a  unique 
positive  semidefinite  solution.  Solving  for  P,  from  equation 
II  lb)  and  substituting  into  equation  ( I  lal  gives 


0=-P,.4o  +  .4  '>P'"-[_[4:^8,g:]'i[4,,-B:G1]_ 


re.  AzT  1 

LC’i  <?j1“[-9jj  +  B2G2]"'[42i  +  B2G|] 


Theorem  2.  If  .422  and  40  are  stable,  then  T  possesses  a 
power  series  expansion  at  ji-0.  that  is 


Proof.  The  proof  is  similar  to  the  proof  of  Theorem  1  and 
is  omitted  for  brevity. 

We  now  desire  to  compare  the  performance  costs  that 
result  when  the  original  control,  equation  12)  and  Ihc  reduced 
control,  equation  1151  are  applied  to  equation  ill.  By  sub¬ 
tracting  equation  |9|  from  equation  1 17)  and  letting 

IV  =  r-P  (19) 

we  get  a  new  Lyapunov  equation  in  W  given  by 

w:.4  +  b[g,g2];  s-;.4  +  b[g,;g:]!  w 
4-rB[S-Gt;  -G.]  +  [S-G,  :  -G2]'BT 

-[JjJflG.iGJ-a  (201 


+  [G'i :  -  [-4,,  +-B2G,]'([4j2  *  B,G;]  ' 1 1  G'2l  ( |  s) 

I 

~G2[,422  -i-  B.G.1"  '[42,  4-  fl.GJJ 

If  4.,  is  stable,  equation  112)  possesses  a  unique  solution. 

To  find  the  second  term  in  the  expansion  we  substitute 
equation  HO)  into  equation  (9)  and  take  the  first  partial  with 
respect  to  p  at  p=*0.  This  gives 

0  =  PV T-4 1 ,  4-8,0, ]4-[4u  4- BIGI]  P‘1“ 

-i-F."[.42|  ^B2G,]^[4,,  +B,G,]'P2'"  ( 1 3al 

0-P/T.4,  ,4-  B,G,J  4-  F.1,[422  -cfl.G2] 

*4 [-4, 1  4-BiG,]T 24-[.4;i  -B.GJ'F,"  (I3bl 

0-FJ,T422  4-fl!G2J*[.4,2-B2G2]FJ1’ 

4- [.4, ,  4-  B,G2]'P,  4-  P',[  4 )2  4-  B, G 2 ].  1 13c) 

If  [  422  4-B.G,]  is  stable  equation  1 13c)  has  a  unique  solution. 


Since  T  qnd  P  possess  power  series  expansions  at  |i*»  0  it  is 
easy  to  show  that  W  also  possesses  a  power  series  expansion 
at  u”0- 

Theorem  3.  If  422.  ,4„.  and  [  422  -S2G2]  arc  stable,  then 
the  constant  terms  of  the  power  senes  are  T  and  P  are  equal, 
that  is 

3*  =J  4-01^1.  (21) 

Proof.  Substituting  the  power  series 

W,  11W.  1  U'f  If'1,'1  nr/1] 

4-  '  .  :  1 221 

„W.  utVjJ  l  \jtWV'  nW'i‘ J 

into  equation  120)  and  evaluating  at  (i«0  yields 

0-W,[4,,4.B,G,]*tV.[4.1^B.G,]4-[4,,*B,G,]W'l 

4-  [.4  2 1 4-B2G,]ir2*rlBt[s-G,]4.r,B,[s-G,] 
4-[S-G,]'fl',r,  4-[S-G,]  B'2r.  4-S  RS-G,RG,  (23l 


0=  »i[  -I,  J  +  8,G.]  4-  tF,[  .4,,  4-B2G,]  +  [  421  +  BjGJW'j 
-r1B1Gj-rifl,c!+[s-G,]B;rj-Gi/?c1  (24» 

0»H)[M”  +  B,G,]  +[ 4j2  +  B,G,]  W'j  - r,B2Gj 

-GjB'jTj  -GjBGj.  (25) 

To  show  that  equation  (21)  is  true  we  must  demonstrate  that 
IF,  »0.  If  [.-I,,  -t-BjGj]  is  stable,  we  may  solve  for  W, 
uniquely  in  equation  |24).  When  this  is  substituted  into 
equation  1 23)  we  get 

0-  WtA0  *  A„W,  -[.4,,  +B2G,]([M,j  4-8,0,]' 1 )' 

X  J[.4j2  4-8,G2]’IFj  +  4-  fl,G,] 

—  i"jB2G2  —  G.8'2r2J[  422  4-  B,G2]  '[42|  f  B2G,] 

4- G, RG,[,-12,  4- B2G2]  1  [-42i  +  B2G| ] 

4* [.42i  4-  82G,]’([.422  4-  fl,G2]  1  I'G'.KG, 

4 -SRS-G.RG,.  (26) 

Substitution  for  S  from  equation  (IS)  and  then  using  equation 

(2S)  yields 


0-IV,.4o4-.4iW,.  (27) 

If  4„  is  stable  then  the  unique  solution  of  equation  |27)  is 

IF,=0.  (28) 

i 

This  implies  that  0(p)  and  so  Theorem  3  is  proved. 

Notice  that  for  the  original  control  in  equation  (2).  it  is 
assumed  that  G,  and  G,  are  chosen  so  that  42,4-B2G,  and 
40  are  stable.  In  order  to  use  the  reduced  control  in  equation 
115).  we  further  assume  that  ,422  is  stable. 

4.  Conclusions 

We  have  shown  that  given  any  linear  stabilizing  control 
which  is  a  function  of  fast  and  slow  states  that  it  is  possible 

to  design  a  lower  order  control  as  a  function  of  slow  states 
alone  which  gives  an  0(/i|  approximation  to  the  quadratic 
performance  cost.  However,  it  should  be  noted  that  the  state 
trajectories  will  not  be  close  except  outside  the  usual  initial 
boundary  layer  after  the  fast  transients  have  died  out. 
Knowledge  of  the  value  of  the  small  parameter,  u.  is  not 
necessary  to  achieve  the  results  derived  in  this  paper. 
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A  Two-Stage  Design  of  Linear  Feedback  Controls 

R.G.  PHILLIPS 


bmooucnoN 

In  this  paper  we  dacompoat  the  feedback  design  of  the  a-dimcMjon*1 
system 


into  two  reduced-order  subsystems  designs  In  (1)  the  control  u  is  in 
m-vector  and  Au  are  («,  x*()  matrices;  f— 1,2;  1,+Sj**.  In  most 
applications  a  denied  effect  of  feedback  is  to  move  the  eigenvalues 
farther  left  in  the  complex  plane,  which  also  increases  their  magnitudes. 
In  the  proposed  two-stage  design  procedure  the  n,  eigenvalues,  which 
were  larger  in  the  open-loop  system  OX  also  become  the  n,  larger 
eigen  values  of  the  designed  cioeed-loop  system.  In  other  words,  tb* 
requirement 

|A(|>|A,|,  1-1, _/-#»,  +  !,•••,»  (2) 

is  satisfied  at  each  design  stags.  Similar  two-stags  designs  can  be  ’ 
on  any  block-diagonalizing  transformation.  The  main  tool  of  the  dr/ 
proposed  here  it  in  explicitly  invertible  tnaeformanon.  Its  properties  an 
reviewed  first-Then  the  design  procedure  is  presented.  Finally,  we  show 
that  earlier  proposed  decompositions  such  as  (1J— (3J.  applicable  to  angu¬ 
larly  perturbed  systems,  are  special  cases  of  this  procedure  when  eigen¬ 
value  separation  (2)  is  sufficiently  large. 


An  Explicitly  Invcmibu  Tkanskhusation 


It  can  easily  be  verified  that  the  transformation 


ly-ML  -M 
L  /, 


(3) 


where  /,  is  the  n,  xn,  identity,  i— 1,2;  A#  is  /»|  Xn2;  and  L  is  n}  xn,  bat 
the  following  properties. 

1)  For  any  L  and  M  the  inverse  of  T  is 


-L  h-LM  ' 


<A) 


2)  If  L  satisfies 

(i4ji  +LA,,  -AuL—LAnL~Q 

and  M  satisfies 

4|j  +L4q)  +4j2  — 0, 

then  y-  Tx  transforms  (I)  into 


(5) 

(6) 

(7) 


P, -^n (8) 

<7,  -  (  /,  -  ML  )8,  -  M 8, ,  </,  -  LB ,  +  8, . 


wbare 


Now  that  |X(fi»>|\(/j)|  u  required  by  (2)  assure*  that  M  is  uniquely 
determined  by  (6).  It  is  also  useful  to  note  that  Lm 0  when  A2X  “0  and 
,V-0  when  Ax i  >0.  Rapidly  convergent  iterative  methods  are  available 
[4]  for  computing  L  and  M.  Now  also  that,  in  general,  a  permutation  of 
states  in  (1)  is  necessary  to  isolaw  fast  and  slow  states.  An  algorithm  to 
accomplish  this  is  given  in  (4). 

Th*  Two-Stao*  Dejion 

For  clarity  we  assume  that  compleu  controllability  of  (1),  which 
implies  the  same  for  th*  subsystems  in  (7),  that  is,  for  th*  pain  (Ft,  (7,) 
and  (Fj.GiX  and  consider  the  pole  placement  problem  for  (1)  using  a 
stat*  feedback  control  u—Kx. 

In  tbs  first  stage  we  design  an  ntxn,  feedback  matrix  Hx  to  place  the 
eigenvalues  of  FX+GXHX  at  th*  desired  *|  locations.  The  substitution  of 


into  (3)  yields 


u«u,  +«j  *[F|0)y+«j 


.  !>,+<?,#,  0]  \GX 


.  Fx  +</,»,  0 

f“l  0 


Gx 

G,+L<7,J  * 


«i-[0  H2 ]x 


into  (10)  results  in 


Whan  this  ratio  is  small,  as  in  singularly  perturbed  systems,  than  a  few 
iterations  are  typically  sufficient 


This  property  is  illustrated  by  a 
whose  system  matrices  are 


power  system  control  problem  (6] 


-5 

0 

0 

0 

4.75 

0 

0 

0 

-2 

0 

0 

0 

-2 

0 

-0.08 

-0.11 

-3.99 

-0.93 

0 

-0.07 

10 

0 

0 

142 

-149 

0 

0 

0 

0 

0 

0 

0 

-04 

0 

0 

0.17 

0 

0 

0 

0 

-0.17 

0 

0 

0 

0  4 

0 

0 

0 

-04 

.0.01 

0.01 

- 

0.06  0.12 

0 

0.01 

0 

(19) 

Too 

10  0 

0  0 

0  0] 

(20) 

Lo  o 

0  0 

4  0 

0  oJ 

Now  w*  apply  to  (11)  the  transformation  (3)  and  denote  it  by  T.  In  (1 1) 
the  block  “1,2"  is  zoo;  hence,  M~0  and  only 

L(FX  +GxHy)-F2L+G2Ht  -0 

needs  to  be  solved  for  L  The  transformation  r  —  7V  yields 


with  open-loop  eigenvalues  of 
X,»-44S 
X,--J.OO 
X)  *  —2.00 
X  4  -  - 1-39 


XJi4--0.13±iiy 
\y  m  —0.17 

x,--<u 


Th*  minimum  open-loop  separation  ratio  is  about  1:3  far  |X3|:|X4|,  that 
it,  with  n,  ■*]  >4.  After  two  iterations  L  is  approximated  by 


/  .  0.034 

1  -0.001  - 
.0.002 


0  0  0 

0  0  0 

0.001  0.048  -0.001 

0.007  0.014  0.092. 


Again  we  note  that  th*  pair  (F±,G2  +LGX)  is  completely  controllable 
and  w*  proceed  to  the  second  stage  in  which  we  design  an  eiXn2 
feedback  matrix  H2  to  place  the  eigenvalues  of  F2  +(Gj  +  LGX)H2  at  the 
desired  n2  locations.  Substituting  the  feedback  control 


and  M  by 


0.989  0  0  0 

-0.137  1.091  0  0 

-0.006  —03)12  2459  -1.966 

0.006  0.032  2.48  -1.623, 


resulting  in 


»-([»,  0]T+[0  H2]fT)x.  (14) 

Expressing  T  end  T  according  to  (4)  we  obtain  the  final  form  of  the 
feedback  matrix  K  in  u— JCx: 

1C- [(»,+«,(  Z.-£))(/-JtfZ,):-/flXf+/fj(/+ijlf)].  (tS) 

Although  this  two-stags  design  is  presented  in  terms  of  e  full  state 
feedback,  it  also  can  be  used  in  output  feedback  design. 

AmomunDnoN 

__  The  form  (14)  of  the  final  result  is  valid  for  any  transformations  T  and 
T  block  diagonalizing  (1)  and  (1 1).  respectively.  However,  the  usefulness 
of  this  approach  depends  on  the  computational  effort  needed  to  obtain 
these  transformations  and  their  inverses.  Th*  advaatagss  of  (3)  are,  first, 
its  explicit  inverse  (4)  end,  second,  the  recursive  determination  of  L  and 
M  [5J.  First 

£*♦1  (1®) 
f-o  “ 

and  then  M  from 

Mk+X  +  LAx2)+Axx[Ax2LMk  lyfu  0^) 

M*  —  —A{\lAl2. 

i 

A  similar  recursion  is  used  for  L.  Convergence  raw  of  these  iterations 
is  known  [4]  to  be  of  order  «*  where  e  is  the  "separation  ratio" 

supJM M 
iaf)X(F,)r 


5 

0 

0 

0 

-  0.068 
'  0.056 

-2 

-0.033 

0 

-4455 

0 

-0.011 

(23) 

.0 

0.002 

1423 

— 1463 

I 

<=>[ 

o  o 
$ 

0.025 

9.123 

1  1 
©  o 

n 

(24) 

For  desired  eigenvalues 


X,j(dos)- -i±2j 
Xj(des)—  -6 
X«(des)-  -4. 


A  feedback  gain  Hx  is  obtained  as 

U  m[  -0.615  -  20.865  0 

'  L  0.009  -0.016  -0.777 


°  I 

— 1.843  J 


To  design  a  feedback  H2  for  the  pair  (F2,  G2  +LGX),  we  first  find  Lx 

'  -0.020  6.178  0  0 

r  _  0.007  -  0.033  "0  1263  J. 

— 1  "  rt  rtft,  ftnnr  AIM  *  * 


resulting  in 


-0.001  -0.001  057  0.132 

0  -  0.002  0.015  0.035  J 


-0.2  0  0  0 

*.  _  0.164  -  0.167  0  0 

1  -0.003  -0.006  -0.015  -0.439 

.  0.008  0.023  0.137  -  0.262  J 


[c,-L</l]r-[ 


0.533  0.045  -  0.001  0.002] 

0  0  0.088  0.031  J' 


For  desired  eigenvalues  of 


XJit(das)--2±l  J 
X,(des)--1 
X,(das)--0.5 


•  feedbnc k  pa  X,  is  obtained: 

„  J  -2.615  -49.15  0  0  1 

2  L  —0234  -1.142  -  2266  -  39.916  J'  {> 

Tbs  actual  closed-loop  eigenvalues  using  tht  composite  feedback  (14)  are 

X,  ,j(CL)- -7.99-l.99y  X5<(CL)- -2*  lj 

Xj(CL)»  -6.09  X7(CL)-  - 1.03 

X„(GL)- -3.93  X^CL)--02 

and  are  cioee  to  thar  desired  locations,  the  wont  error  being 
(X,(CL)-X,(dss)) 


X7(das) 


■  *3  percent. 


AnUCAItOM  TO  SINGULAR  PXRTVRXATTONS 

The  approach  presented  here  often  a  ampler  way  to  obtain  tome 
known  results  for  singularly  perturbed  systems  (11  (2J. 

Consider  the  system 


i-f  A''  1*4 


tx 

If  in  this  case  L  and  M  are  approximated  by 
Lm  -iXjiXJI1 

then  the  transformed  system 


«/• 


4i+fi4Ml'4uAg 

«A» 


(30) 

(31) 

(32) 


(33) 


is  0(<)  does  to  the  block  disgnnal  form  (7)  when 


where 

Etim  ~AuAuAii*AU‘ 

The  feedback  H1  is  dasipmd  for  the  pair  (X#, The 
respiting  dosed  loop  eigenvalues  corresponding  to  this  subsystem  win  be 
of  the  form  X(<tai)  +0(<).  Substitution  of  (31).  (32),  sad  (35)  into  (15) 
gives  the  composite  feedback  matrix 

AT-[xfl:/f,/<l1,i4,2+/f,]+0(e).  (37) 

This  parallels  the  results  of  (1)  where  and  fi2  were  the  results  of 
two  reduced-order  linear  optimal  regulator  problems. 

In  [2]  sad  0(e)  independence  of  the  two  stages  was  accomplished 
using  a  particular  form  of  the  control  u}  in  the  design  of  Xf2,  namely, 

«j-(/+/f,^n,5,)o  (3S) 

resulting  in  the  control  matrix  of  (36): 

(n,+e^f;,d,Jg#)(/+ff,/fH,nI)  p  ^ 

«B0(/-lf1(AI1  +*IH,)*,Bl)(/+ffIV*t)«’°(«I)  ' 

Using  a  known  matrix  identity,  it  can  be  shown  that  the  matrix 
multiplying  <Bg  in  (39)  is  /,  and  hence  the  subsystem  pair  for  the  seco>  d 
stage  is  (d»+0(<).  50  -0(«)).  Since  it  is  independent  of  XT,  up  to  0(c) 
terms  the  need  for  toiring  //,  into  account  in  the  second  stage  has  been 
■HmiMtei.  The  composite  feedback  matrix  of  (IS)  now  becomes 

XT-  [  Xf,  :/M,l  'Axl  ♦  H2(  /+  H,Art  lB , )  ]  (40) 

which  parallels  the  results  of  [2]  and  (3). 

Conclusions 

An  explicitly  invertible  transformation  enables  a  reduced-order  eigen¬ 
value  placement  problem  to  be  solved  in  two  stages.  The  only  requ 
meat  on  the  open-loop  system  is  that  the  spectrum  be  disjoint.  Ea> 
decompositions  applicable  to  singularly  perturbed  systems  appear  as 
«  of  this  two-stage  procedure  when  the  eigenvalue  separation 
was  sufficiently  large.  A  similar  design  procedure  for  diecrete-tin.c 
systems  is  developed  in  (7J.  Finally,  the  dacompoation  is  applicable  to 
design  criteria  other  than  eigenvalue  locations  and  output  feedback 
problems. 


Ae~Aa-AilAn'Aa 


Xf,  can  now  be  designed  to  plaoe  the  eigenvalues  of  ,4, ,-f  6, Xf,  atX*, 
locations.  The  resulting  closed-loop  eigenvalues  will  be  of  the  form 
(\em)  +0(e))/c.  The  partially  closed-loop  system  of  (33)  is  now  given  as 


An  +5,Xf,  +«£|| 
*B9Hl+*tAtAiiAu> 


—tAliAJlA{l1An 
<At  — «,^o^ll^H,<f  U 


y 


Bx  ‘'f  u^o 

«*o 


“J 


(34) 


where 
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Introduction 


[16]  that  a  dynamic  loop  whose  gain  tends  to  infinity 
causes  change  in  the  system  order,  characteristic  of  singu¬ 
lar  perturbation.  In  fact,  all  singularly  perturbed  systems 
can  be  represented  as  high-gain  systems  and  all  high-gain 
systems  can  be  analyzed  as  singularly  perturbed  systems. 
The  class  of  linear  time-invariant  high-gain  systems  dealt 
with  in  this  paper  and  in  [13],  [14]  is  of  the  form 


HIGH-GAIN  feedback  has  been  a  classical  tool  for 
reduction  of  effects  of  disturbances,  parameter  var¬ 
iations,  and  distortions.  Although  limited  to  single  in¬ 
put-single  output  feedback  systems,  the  early  investiga¬ 
tions  of  structures  permitting  high  gains  [1],  the  rules  for 
root  locus  asymptotes  [2]  and  the  results  on  sensitivity  and 
return  difference  [3],  [4]  had  greatly  deepened  the  intuition 
of  control  engineers  in  the  1950’s.  Recent  developments  in 
the  multivariable  system  theory  have  revived  the  interest 
in  high-gain  systems.  First,  in  the  works  on  disturbance 
rejection  [5],  parameter  uncertainty  [6],  and  decoupling  of 
large  scale  systems  [7],  high-gain  coefficients  are  either 
purposely  introduced  in  the  problem  statement  or  they 
implicitly  appear  in  the  resulting  feedback  structures.  Sec¬ 
ond,  in  a  class  of  so  called  variable  structure  systems  [8], 
[9],  the  sliding  mode  which  occurs  on  switching  surfaces 
can  be  analyzed  using  high-gain  methodologies.  Third, 
feedback  implementations  of  optimal  controls  when  only 
small  penalities  are  made  on  control  variables  (the 
“cheap”  control  problem)  result  in  loops  with  high  gain 
[10],  [11].  Fourth,  various  recent  studies  of  multivariable 
system  transmission  zeros  [12H14]  and  root  locus  asymp¬ 
totes  [15]  also  exploit  a  high-gain  analogy. 

A  fundamental  property  of  high-gain  systems,  which 
brings  us  to  the  subject  of  this  paper,  is  their  relationship 
with  singularly  perturbed  systems.  It  has  been  observed  in 
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(1) 

o  (2) 

where  g  is  the  large  scalar  gain  factor,  the  state  x  is  an 
n-vector,  and  the  control  u  is  an  m-vector.  The  relation¬ 
ship  between  the  system  (1),  (2)  and  a  standard  singularly 
perturbed  linear  time-invariant  system, 

zmFn2  +  F l2y  (3) 

Hy-Fuz  +  F^y  (4) 

where  n  is  a  small  scalar  parameter  will  be  established  by 
considering  that 

/z-1,  g— oo,  n—0.  (5) 

In  this  paper  we  demonstrate  how  the  singular  perturba¬ 
tion  methodology  can  unify  and  simplify  known  facts 
about  high-gain  systems  and  give  new  interpretations  of 
their  properties.  A  new  pole  placement  method  and  a 
decomposition  of  near  optimal  high-gain  regulator  prob¬ 
lems  are  presented.  Furthermore,  connections  among  ap¬ 
parently  unrelated  notions  such  as  transmission  zeros, 
cheap  controls,  and  sliding  modes  in  variable  structure 
systems  are  clarified. 

Fast  and  Slow  Modes  and  Transmission  Zeros 

In  this  section  we  reveal  the  mode  separation  property 
of  high-gain  systems  and  relate  it  to  the  notion  of  trans¬ 
mission  zeros.  The  feedback  system  (1),  (2)  with  /*sl/g 
becomes 

f«o"(Mo+floCo)->Co-  (6) 

It  will  now  be  shown  that  if 


rank  B0C0  -  rank  C0B0  (7) 

Copyright  ©  1977  by  The  Institute  of  Electricel  end  Electronic*  Engineer*,  Inc. 
Printed  in  U.S. A.  Anns!*  No.  7I2AC005 


I. 

f 

[ 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  AC-22,  NO.  6,  OBCEMMR  1977 


and  if  the  nonzero  eigenvalues  of  B0C0  have  negative  real 
parts 

Re\(B0C0 )  <  0,  i  - 1,  •  •  •  ,m,  (8) 


then  the  motion  of  (6)  consists  of  a  fast  transient  to  a  0(  m) 
neighborhood  of  CqXq^O,  followed  by  a  slow  motion  in 
this  neighborhood.  When  assumption  (7)  is  not  satisfied, 
the  limiting  phenomena  as  g-»oo,  that  is,  n-*0,  are  more 
involved  and  will  not  be  analyzed  here.  Assumption  (8) 
assures  the  asymptotic  stability  of  the  fast  transient.  To 
convert  the  system  (6)  into  the  standard  singularly  per¬ 
turbed  form  (3),  (4)  let  i-  Tx0  where 


T- 


MsTM 


(9) 


and  M  is  a  product  of  elementary  row  transformations  on 
B0  such  that 


MB0m 


CoAf-fC,  C2], 


(10) 


0<M<A.  (17) 

then  (6)  is  equivalent  to  the  block  triangular  system 

i-[/r1i-/Jri2(L0+M<7)]z  +  fr,2n  (18) 

ltri-[C0B0+  nH2  +  ti2(Ln  +  hG)F12]t)  (19) 

and,  hence,  its  eigenvalues  are 

V-^[\(Coao)+0(M)]  i- (20) 

Y-ty/'iiJ+O^)  jm  1,*  ••  ,n  —  m.  (21) 

Moreover,  for  sufficiently  high  gain,  that  is  for  \i 
sufficiently  small,  the  fast  subsystem  (19)  is  asymptotically 
stable. 

The  proof  follows  from  (10>— (16)  and  the  existence  of  G 
established  in  Appendix  B.  The  asymptotic  stability  of 
(19)  follows  from  assumption  (8)  and  from  the  fact  that 
the  nonzero  eigenvalues  of  B0C0  are  the  eigenvalues  of 
CoB» 

\(C02f0)-'\(2f0C0),  \*0,  f- (22) 


We  note  that  mxm  matrices  B2  and  C2  are  nonsingular 
because  of  C0f?0-  C2B2  and  assumption  (7).  It  is  shown  in 
Appendix  A  that  the  meaning  of  T  is  that  it  decomposes 
the  original  state  space  of  x0  into  the  null  space  of 
Co, 3t(Co),  and  the  range  space  of  B0,9.(B<^.  Then  xQ  can 
be  written  as 

x0-Nz  +  B0(C0B0r'y  (11) 

where  CqN — 0.  Also 

y-c^o  (12) 

and  z  «■  Mtx0  where  M,B0—9.  Such  decompositions  also 
appear  in  MacFarlane,  Kouvaritakis,  and  Shaked 
[I3H15].  The  system  (6)  is  thus  transformed  into 

zmFllz  +  Fny  (13) 

y.y-nHtZ+(C0B0+iiH2)y.  (14) 

The  block  triangularization  [17],  [18],  which  is  simpler 
than  Jordan  transformations  used  in  [  1 3}— [  1 5],  is  now 
applied  to  (13),  (14)  to  exhibit  the  two  time  scale  property 
of  high-gain  feedback  systems.  We  introduce  the  “fast” 
variable 

t)->-  +  /iLz  (15) 

where 

£.-(C0^+/J/2)"l//,  +  fiC-i0+pC.  (16) 

A  recursive  formula  for  calculating  G  and  an  upper  bound 
for  n  (that  is,  a  lower  bound  gc  for  g)  are  given  in 
Appendix  B.  The  resulting  separation  of  slow  and  fast 
modes  is  now  summarize.  .  the  following  theorem. 

Theorem  I:  If  the  u...,,  ain  system  (6)  satisfies 
assumptions  (7)  and  (8) ...  .u  . 


The  two  time  scale  property  of  high-gain  system  (6)  is 
exemplified  by  the  presence  >f  CX 1  / m)  large  eigenvalues  A/ 
and  the  eigenvalues  Y  which  are  0(1).  The  fast  variable  i) 
decays  exponentially  in  the  “stretched”  time  scale  r / p  and 
for  t>ts  it  is  0(e '**'■)  where  \«|maxRe\(C0B0)|.  In¬ 
tegrating  (18)  by  parts,  the  slow  variable  can  be  approx  • 
mated  by 

z(l)«ef"'z(  0)+0(p).  (23) 

Hence,  the  decomposition  (11)  of  the  original  state  space 
corresponds  to  the  separation  of  time  scales  and  .toft)  is 
approximated  by 

x0(t)  -  NeF'"z( 0)  +  B0  ( C0B0 )  ~  'e™">r,(0)+0(  M).  (24) 

which  proves  that,  in  the  limit,  the  fast  transient  occurs  in 
<31  (Uo)  and  the  slow  motion  is  confined  to  X(Cq).  For 
t>t„ 

y(')”/*T0z(/)  +  (H  M2)-  (25) 

If,  in  an  output  regulator  problem.  CqXq  is  defined  as 
the  output  of  (1)  to  be  forced  to  zero  (“zeroing  the 
output”  [24]),  then  from  (25),  we  see  that  y(t)  is  reduced 
to  an  0(  n2)  quantity  after  t  >  r,. 

Another  interpretation  of  Theorem  1  is  that  it  encom¬ 
passes  and  extends  results  on  root  locus  asymptotes  and 
transmission  zeroes  of  multivariable  systems  [  12]— { 1 5],  As 
g-»  oo.  /a-»0.  the  eigenvalues  Kf  in  (20)  tend  to  infinity 
along  the  asymptotes  defined  by  the  directions  of 
\(C0£0),  which  are  the  root  locus  asymptotes  obtained  in 
[15].  For  large  but  finite  values  of  gain  g,  the  eigenvalues 
A/  can  now  be  computed  from  (19),  or  more  simply 
approximated  by  neglecting  the  0(  fi2)  terms  in  (19). 

Wang  and  Davison  [12]  and  Kouvaritakis  and 
MacFarlane  [13]  have  shown  that  the  finite  limits  of  the 
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eigenvalues  of  the  high-gain  feedback  system  (6)  as  gain 
g-»  oo  are  the  transmission  zeros  of  the  open  loop  system 
(1)  with  the  output  y  -  C<>x0.  Therefore,  the  limits  Ay(F,,) 
of  the  eigenvalues  Xf  are  the  transmission  zeros.  Theorem 
1  and  Appendix  A  provide  the  following  procedure  for 
calculation  of  transmission  zeros.  Find  the  matrix  A/r- 
[ A/,r  Af2r]  in  (10)  and  its  inverse  Af-,-[S,  SJ,  where 
and  S2  are  n  X  m  matrices.  This  is  easy  since  M  is  a 
product  of  elementary  row  transformations.  Then  form 
CqM  ~ 1  -[C,  CJ  as  in  (10),  find  C{ and  compute  the 
eigenvalues  of 

F„-A/1^o(S,-S2Ci-,C,)  (26) 

which  are  the  transmission  zeros  of  (1),  (12).  The  deriva¬ 
tion  of  (26)  is  given  in  Appendix  A  where  it  is  shown  that 
the  last  matrix  in  (26)  and  the  matrix  N  in  (1 1)  have  the 
same  range: 

^(AfJ-^S.-SjCj-'C,).  (27) 

Therefore,  our  matrix  Ft ,  coincides  with  the  "zero-matrix” 
in  [6],  (13)— {15]  for  the  specific  choice  of  the  basis  for 
01  (Cq).  The  calculation  of  transmission  zeros  from 
matrices  of  the  form  (26),  such  as  in  [  1 3]— { 1 5],  [19],  avoid 
the  ill-conditioning  due  to  the  large  gain  factor  present  in 
[121,(20]. 


Pole  Placement 


For  the  remainder  of  the  text  the  matrix  C0  in  (2)  is 
considered  free  to  be  chosen  in  the  state  feedback  design. 
To  stress  this  fact  this  state  feedback  matrix  is  denoted  by 
K.  We  first  develop  a  design  method  in  which  the  two 
time  scale  property  of  high-gain  systems  is  exploited  to 
separately  place  fast  and  slow  eigenvalues.  To  simplify  the 
notation  we  will  deal  with  the  system 


x,  +/l,jx2  (28) 

xl^A2lxl  +  AI2x2+  B2u  (29) 

which  is  obtained  from  (1)  using  x-[,v,  xj7"-  Mx0 
where  M  is  as  in  ( 10).  The  m  x  m  matrix  B2  is  nonsingular 
by  assumption  (7)  and,  hence,  the  pair  (An,  is  control¬ 
lable  for  any  A  22- 

Lemma  I:  If  the  pa  •  (A^Bq)  in  (1)  is  controllable 
(stabilizable),  then  the  pair  (A,t,Al2)  is  controllable 
(stabilizable). 

Proof:  The  controllability  of  (A^  B0)  implies 


rank 


ol-  A  u 
^21 


ol-  A 


22 


0 

*2 


n 


and.  since  rank  B2  -  m. 

rank  [  ol  -  A , ,  Ai2]mn-m 


(30) 


(31) 


for  all  complex  a ,  that  is,  (y4  ,,.aI  ,2)  is  controllable.  When 
Mo,S0)  is  only  stabilizable,  consider  u-c- fl2~'^2,x,. 
Since  is  controllable.  rank[o/-/4,,  Al2\<n 


-  m  and  all  the  uncontrollable  but  stable  eigenvalues  of 
Aaue  eigenvalues  of  An.  Hence,  (A n,/4l2)  is  stabilizable. 

Theorem  2:  Let  (A^Bq)  be  a  controllable  pair,  and  let 
the  (n-m)xm  matrix  K,  and  the  mXm  matrix  Kf  be 
such  that 

tyA\i~Aii  *.)*<?,  y-l.--.n-m  (32) 

\(B2Kf)mpit  Rep,<0,  1-1,  --.m  (33) 

where  and  gp,  are  the  prescribed  locations  of  the  slow 
and  fast  eigenvalues,  respectively.  Then  the  use  of  the 
high-gain  feedback 

u  -  gKx  -  g[  KfKtx,  +  Kfx2  ]  (34) 

places  the  eigenvalues  of  the  system  (28),  (29)  to  q>  + 
0(  1  /g)  and  g[p,+0{]/ g)J. 

Proof:  Substitution  of  (34)  into  (28),  (29),  and  the 
transformation  z  —  x,(  y  -  KfKsx,  +  Kfx2  yield 

2 m{A  11  ~  A  ]2K3  )z  A- A  (35) 

Pym  11 —  ^22^j  ~  KiA  uKs  +  A  \2\z 

+  KfB2  [  /  +  pB2~ 1  ( Ks  +  A  22Kf- 1  )  ]  y .  (36) 

Noting  that  \(KfB2)^X{B2Kf),  the  proof  follows  from 
Lemma  l  and  Theorem  1 . 

A  procedure  for  completely  separated  placement  of  the 
slow  and  fast  modes  is  to  design  K ,  to  place  the  eigenval¬ 
ues  of  rl,|  —  A]2K,  and  design  Kf  to  place  the  eigenvalues 
of  B2Kf.  The  n -dimensional  eigenvalue  placement  problem 
is  thus  decomposed  into  lower  dimensional  problems.  The 
preceding  design  is  an  improvement  over  the  technique  in 
[21].  The  fast  eigenvalues  can  now  be  placed  arbitrarily  in 
the  open  left  half  complex  plane  while  in  [21]  they  are 
restricted  to  lie  on  the  negative  real  axis.  The  placement  of 
slow  eigenvalues  is  performed  by  solving  a  standard  pole 
placement  problem  of  lower  dimension  while  in  [2J],  it  is 
done  by  solving  n-m  linear  equations  det[AT(<7y7- 
<4o)“ 'Rol ”0, j  —  I, ••  • .« - m,  for  the  m x n  elements  of  K. 

High-Gain  Regulators  and  Cheap  Controls 

High-gain  feedback  systems  can  also  result  from  the 
optimization  of  system  (1)  with  respect  to  a  quadratic 
performance  index  having  small  penalty  on  u: 

J-^f™[x0rQo.x0+lx2uTRu]dt  (37) 

where  @0  >  0  and  R  >0  are  symmetric  and  p  is  a  small 
scalar  parameter.  Such  “cheap  control”  problems  have 
been  studied  by  O'Malley  and  Jameson  [10),  [22], 
Kwakemaak  and  Sivan  [11],  [23],  Wonham  [24],  and 
others.  Detailed  results  exist  [10]  for  the  case  when 


BoTQ0B0  >  0.  (38) 
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Under  this  condition  the  resulting  high-gain  system  satis¬ 
fies  our  assumption  (7).  The  analysis  of  the  preceding 
sections  is  applicable  and  reveals  the  two  time  scale  prop¬ 
erties  of  the  optimal  state  regulators  developed  in  [10]. 
Without  loss  of  generality,  we  deal  again  with  the  system 
(28),  (29)  instead  of  with  (1). 

From  the  fast-slow  separation  of  the  po  cement 
design,  it  can  be  expected  that  a  similar  decomposition  is 
feasible  in  the  near  optimum  high-gain  regulator  design. 
This  is  done  by  the  method  of  [25],  Instead  of  the  problem 
(IX  (37),  the  following  two  reduced  order  regulator  prob¬ 
lems  are  solved. 

Problem  “s":  Optimize  system  (39)  with  respect  to  the 
performance  index  (40). 

x,mAX\X,  +  Anu,  (39) 

J,m\  +  WQl2us  +  “/( ?22«,)  dt-  (40) 

Problem  ‘TV  Optimize  system  (41)  with  respect  to  the 
performance  index  (42). 

(41) 

J/m\fJ‘(xfrQnxf+u/rRuf)dt-  (42) 

In  (39),  (41),  matrices  An,  /lu,  and  B2  are  as  in  (28),  (29), 
and  x,  is  an  (rt  -  m)-ve ctor,  xf,  uf,  u,  are  m-vectors,  and  Qv 
are  the  submatrices  of  Qm(M  ~  ')rQ0M  ~ 1  where  M  is  as 
in  (10). 

Lemma  2:  If  the  pair  (A0,  B0)  is  stabilizable  and 

(AU,D)  is  detectable,  (43) 

where 

DTD~QiX-QttQZ'Q&  (44) 

and  if  (38)  is  satisfied,  then  there  exists  a  unique  stabiliz¬ 
ing  solution  P,  of  the  Riccati  equation 

0™  ~  F, (A m  —A |2(?22  '0|2 )  — (-4 ,|  —  Ai2Q22  '0i2 )  P, 

+  P,AnQ*A!zP-DTD  (45) 

and  the  optimal  control  for  Problem  “s"  is 

*  -  Qa '  ( Qr.  +  A  f2P,  K  =  G,x,.  (46) 

Proof:  022 1  exists  since  B<fQ0B0> 0  implies  B2Q22B2 
>0.  By  Lemma  1,  the  pair  (Au,Al2)  is  stabilizable  and, 
hence.  (/!,,  -  A  l2Q2J  '0^.  A  l2)  is  stabilizable.  This 
guarantees  the  existence  and  uniqueness  of  P,  [26]. 

The  optimal  control  for  Problem  "f"  is  readily  obtained 
as 

uf--R- ' B2P,xf  =  Gfx,  (47) 

where,  in  terms  of  S*  B2R~  {B2. 

Pfm  S  ~'/1(S>/lQl2S,/2)wlS  (48) 


A  composite  control  ue  is  now  made  of  the  controls  u, 
and  u}  in  the  form  of  the  control  law  (34): 

ucmg(GfG,xx  +  Gfx2),  (49) 

where  the  feedback  gain  matrices  are  operating  on  the 
actual  state  variables  jc,  and  x2  of  the  system  (28),  (29) 
rather  than  on  x,  and  xf.  The  feedback  system  (28),  (29), 
(49)  satisfies  Theorem  2  with  G,  and  Gf  playing  the  roles 
of  Ks  and  Kf,  respectively.  Hence,  J,  and  Jf  are  the 
performance  specifications  for  the  slow  and  fast  modes. 

Theorem  3:  Under  the  conditions  of  Lemma  2,  the 
control  ue  is  near  optimal  in  the  sense  that  the  perfor¬ 
mance  J  of  the  feedback  system  (28),  (29),  (49)  is  0(  p2) 
close  to  its  optimum  performance. 

Proof:  A  power  series  expansion  of  the  optimal 
Riccati  solution  has  been  derived  in  [10],  Since  our  equa¬ 
tions  (45)  and  (48)  coincide  with  (4.11)  and  (4.9)  of  [10], 
the  leading  terms  K ,  ,0  and  *220  of  the  optimal  expansion 
are  identical  to  our  P,  and  Pf,  respectively.  From  the 
identity,  analogous  to  (4. 10)  in  [  10], 

P,Al2  +  QnmKlxSPf  (50) 

it  follows  that  uc  and  x  of  the  system  (28),  (29),  (49)  are 
0 (/i)  close  to  the  control  and  the  state  of  the  optimal 
system,  and  in  view  of  [25]  the  performance  of  (1),  (49)  is 
0(  ii2)  near  optimal. 

The  results  of  cheap  control  [10]  are  thus  recast  in  tet', 
of  two  separate  problems  providing  a  0(  /x2)  near  optimal 
solution.  It  is  observed  from  Lemma  2  that  the  standard 
detectability  assumption  on  system  (1)  is  replaced  by 
detectability  assumptions  (43)  and  (38)  for  the  slow  and 
fast  subsystems.  The  stabilizability  assumption,  however, 
remains  the  same.  Thus  the  meaning  of  Hypothesis  (H)  in 
[10]  is  to  assume  that  the  slow  eigenvalues  have  negative 
real  parts. 

To  regulate  the  output  y  *  C<>x0  we  use  0»  C0rC0.  If 
rank  C0-/n,  then  a  0(/x2)  near  optimal  control  can  be 
found  by  the  preceding  decomposition  procedure,  in¬ 
troducing  C2xf  and  y,  —  C]x!  as  fast  and  slow  output 
variables  in  (42)  and  (40),  respectively,  where  C,,C2  are  as 
in  (10).  Since  0n  - CfC,,  022*  C2C2  and  C2  is  nonsingu¬ 
lar,  then  0-0  in  (44)  and  (43)  is  replaced  by 

ReA(/tM- ,4  l2C2- '<:,)<  0.  (51) 

The  solution  of  (45)  is  P,  -0,  that  is,  the  slow  eigenvalues 
are  not  influenced  by  high-gain  feedback.  From  Theorem 
1  it  follows  that  A(-4 ,  t  —  -4  ’C|)  are  the  transmission 

zeros  of  the  system  (28),  (29)  with  output  y «  C0.t0.  The 
meaning  of  the  condition  (51)  is  that  they  have  to  be  in 
the  open  left  half  complex  plane.  This  form  is  analogous 
to  the  condition  on  transmission  zeros  in  [1 1]. 

A  related  problem  is  considered  in  [6]  where  a  feedback 
gain  matrix  is  obtained  by  solving  a  standard  linear 
quadratic  state  regulator  problem,  but  no  performance 
index  is  being  minimized  by  the  high-gain  feedback  con¬ 
trol. 
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Sliding  Mode 


A  class  of  systems  with  discontinuous  feedback  control, 
called  variable  structure  systems,  has  been  developed  in 
USSR  in  the  last  15  years  and  surveyed  in  (8],  (27],  [28]. 
The  salient  feature  of  these  systems  is  that  the  so-called 
sliding  mode  occurs  on  a  switching  surface  s(xq)-Q. 
While  in  the  sliding  mode,  the  system  remains  insensitive 
to  parameter  variations  and  disturbances,  similar  to  a 
high-gain  system. 

Suppose  that  the  switching  surface  j(jcq)“  Cojc0“0  is 
chosen  and  assumption  (7)  is  satisfied.  In  sliding  mode, 
that  is,  when  j(x„)-0,  system  (1)  with  a  discontinuous 
feedback  control,  componentwise. 


“<  (■*<>)" 


«f  (* o). 


(52) 


-*l“(i4|l  —  ^12^-2  'C’lJjfi  (59) 

and  A , ,  -  A  ,2C2-  'C,  -  F, ,  by  Appendix  A.  Therefore,  (59) 
coincides  with  (18)  as  g-»oo,  p-*0. 

Thus,  the  slow  motions  of  high-gain  systems  as  g~* oo 
are  the  same  as  sliding  motions  in  variable  structure 
system.  It  follows  that  the  slow  motions  enjoy  the  same 
robustness  properties  of  sliding  motions.  From  our  results 
in  the  previous  sections  and  Lemma  3  it  is  clear  that  the 
eigenvalues  of  the  equivalent  control  system  (53),  (54)  are 
the  transmission  zeros  of  the  system  (I)  with  the  “output” 
s.  Furthermore,  the  switching  surfaces  can  be  synthesized 
by  either  placing  the  slow  eigenvalues  or  solving  problem 
“r”  in  the  last  section,  a  lower  order  state  regulator 
problem. 

Example 


is  governed  by 

*0-^  0*0+ *()««,  (53) 

where  is  the  “equivalent  control” 

”  —  (  CqBq  )  CqAqXq  (54) 


As  a  simple  illustration  consider  a  system  in  the  form  of 
(28),  (29), 


'  3 

1 

1  1 

0 

0 

X  * 

-6 

1 

0 ! 

x  + 

1 

I 

L  0 

0 

3J 

0 

1 

obtained  by  requiring  that 

i  -  CqAqX  „  +  C0Bju  -  0.  (55) 

The  existence  and  uniqueness  of  is  guaranteed  by 
assumption  (7).  In  [9],  it  is  proved  that  the  feedback 
system  (1),  (54)  is  robust  with  respect  to  small  time  con¬ 
stants  neglected  in  the  model,  nonideal  switching  such  as 
relay  hysteresis,  in  the  sense  that  its  trajectory  remains 
close  to  the  trajectory  of  the  equivalent  control  system 
(53),  (54).  It  is  of  practical  importance  to  exploit  the 
results  of  [9]  to  examine  the  robustness  properties  of 
high-gain  systems.  As  a  step  in  this  direction  we  establish 
the  following  relationship  between  high-gain  feedback  sys¬ 
tem  (1),  (2)  and  the  equivalent  control  system  (53),  (54). 

Lemma  3:  The  motion  of  equivalent  control  system 
(53),  (54)  is  identical  to  the  motion  of  the  slow  subsystem 
(18)  of  the  high-gain  feedback  system  as  g-> oo. 

Proof:  Using  the  transformation  jc«*  Mxq,  we  deal 
with  system  (28),  (29)  instead  of  (1).  In  terms  of  x  the 
equivalent  control  (54)  is 

“eq”  ~  (C2R2)  I[(C|^h  +  C2-42|)xi-(-(C|^I2+C2/422)-'c2] 

(56; 

where  C,.C2  are  as  in  (10).  Noting  that 

C,x,  +  C2x2  (57) 

the  equivalent  control  system  becomes 

X|-/4mx,+/1i2X2  (28) 

i-0.  (58) 

Since  in  sliding  mode  r-  0.  we  solve  it  for  x2  and  sub¬ 
stitute  into  (28).  This  yields 


First,  suppose  that  a  high-gain  feedback  control  is  to  be 
found  to  place  the  slow  eigenvalue  near  A,  —  —  3  and  the 
fast  eigenvalues  near  Ajj  — g(-  1  i/1)-  We  solve  the  two 
lower  order  pole  placement  problems  (32),  (33)  and  obtain 


K 


6 

,  Kf- 

or 

.0. 

’  / 

.  -2  0. 

(61) 


The  high-gain  feedback  (34)  is 


u 


0 

-2 


(62) 


Second,  consider  the  high-gain  feedback  system  (60),  (62) 
with  (62)  written  as  gC$x  and  apply  Theorem  1.  The 
closed  loop  eigenvalues  are  computed  approximately  by 
neglecting  the  p2  terms  in  (18),  (19),  that  is. 


A,  -  A(  F, ,  -  jlF.jL,)  -  A(  -  3  +  30,i)  -  -  3 + 30n  (63) 


^2.3m  “M  C0B0  +  pH 2  ) 


XU  UXU  ?]) 

—  (-  1  +  5p±j^\  +  16ft -4fi2  ).  (64) 


The  upper  bound  in  (17)  is  0.0074  corresponding  to 
135.6.  The  exact  eigenvalues  are  computed  for  com¬ 
parison  purposes.  Denoting  the  error  between  the  ap¬ 
proximate  and  exact  eigenvalues  as  etpp  and  between  the 
specified  and  exact  eigenvalues  as  the  results  are 
summarized  in  Table  I. 

From  (63),  (64)  it  is  observed  that  as  p-*0.  A,  2.3  tend  to 
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TABLE  I 


Gain  a 

Exact 

Approximate 

Specified 

percent 

S*  percent 

-2.69324752 

-2.7 

-3.0 

too 

-95.1533625 

-95 

<0.05 

<14 

±7107.955057 

±7107.684725 

- 100±7'100 

-2.96991225 

-2.97 

-3.0 

1000 

-995.015044 

-995 

<0.003 

+71007.99596 

±71007.96627 

-1000±7l000 

the  specified  values.  For  design  purposes  gain  g  does  not  with  C„  C2  as  in  (10).  The  system 
have  to  be  high,  since  with  g  ■  100  the  accuracy  of  14 

percent  in  eigenvalue  location  is  often  acceptable.  x  ■  T MA0M  ~  T-  'x + T MBqU  (A5) 


Conclusion 


by  (A2)  and  (A4)  and  i«*[x  y)T  is  (13),  (14)  with 


Several  classes  of  seemingly  unrelated  problems  are 
shown  to  result  in  or  are  equivalent  to  high-gain  feedback 
systems.  A  singular  perturbation  analysis  reveals  the  two 
time  scale  properties  of  these  systems  and  allows  a  sim¬ 
plified  determination  of  eigenvalues,  root  locus  asymp¬ 
totes,  and  transmission  zeros.  A  separation  of  slow  and 
fast  state  feedback  designs  is  also  presented  for  both 
pole-placement  and  linear  regulator  problems.  For  sim¬ 
plicity  of  comparison  the  results  of  this  paper  are  re¬ 
stricted  to  the  class  of  high-gain  feedback  systems  char¬ 
acterized  by  (7).  It  is  recognized  that  this  structural 
assumption  has  excluded  some  systems  of  practical  inter¬ 
est.  For  example,  in  single  input  systems,  (7)  means  that 
the  number  of  zeros  v  of  the  transfer  function  is  n-1. 
However,  classical  results,  such  as  [1],  exist  for  »<n-\ 
and  show  that  for  v~n— 2  the  system  is  oscillatory  and 
for  v  <  /i  —  2  it  is  unstable.  The  recent  study  of  multivari¬ 
able  root  locus  asymptotes  [15]  also  shows  that  for  more 
general  structures  of  B0  and  C0  instability  of  the  closed 
loop  system  can  result  from  high-gain  feedback. 


Denote 


-^n 

~a12c2  'c, 

(A6) 

mAi2C2  ' 

(A7) 

-C, 

4M  +  C2i42i  — ^2^1 

(A8) 

“(C 

|i4|2+C2^22)C2  '■ 

(A  9) 

Mx 

,  S2] 

(A  10) 

where  A/,,  Sf  are  ( n~m)Xn  and  A/2,  Sf  ar c  mxn 
matrices,  then 

S,A/,  +  52A/2-/.  (All) 

From  (10). 

C,-CS„  C2  —  CS2  (A  1 2) 

B2-M2B,  (A13) 


Appendix  A 


In  terms  of  (A  1 0),  -4 , ,  in  (A2)  becomes 


Consider  the  transformation  x  -  Tx0  as  two  successive 
transformations,  that  is, 

x^Mxq,  xmTx.  (Al) 

Denote 


Atim  MlA0S\.  (A  1  • : ) 

Substituting  into  (A6)  yields  (26).  Using  the  expressions 
(A11)-(A13),  Xo-Af-1r_1i  is 

x0  -  (  5,  -  S2Cf  'C,  )z  +  B0(C0Bo)'V-  ( A 1 5 ) 


MA0M  ~ 


then  the  system 


‘4|i 

^21  ^22 


x  ■  MA0M  (x  +  MB0u 


by  (A2)  and  (10)  is  (28),  (29).  From  (9), 


(A2) 

From  (A  12) 

c(s,-s2c2-,c,)-o 

(A16) 

and  by  defining 

(A3) 

,V  —  S,  —  S2C2_,C, 

(A17) 

(A15)  is  (11).  By  (10)  and  (A10),  x-TA/x0  becomes 


r-'« 


— m 

-Cf'c, 


(A4) 


X 

y 


M[X0 

( C|  A/|  +  C2M2  )xq 


M  ,x0 

Q>*0 


(A18) 
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For  the  system  (13),  (14),  by  Lemma  1  in  [18],  if 
assumption  (7)  is  satisfied  and  if  n  satisfies 

(ia  <\(b  +  2ixacd)  (Bl) 

where  a-IKCAT'll.  *“ll^nll.  c- II  full.  and  d-||//,||, 
then  L  of  (16)  exists.  L~  Lq+iiG  where 

Lo-(C0S0+^2 )"'//,.  (B2) 

From  (Bl),  nc  in  (17)  is  obtained, 

(b2  +  \cd)'/2-b 


By  application  of  the  implicit  function  theorem  to 

(  C0B0+hH2  )G  -  nGF, ,  +  n  2GFi2L0  +  n2L0Fl2G 

+  /t3 4 * 6 7CF|jC”  LqF^  —  /lLqFjjLo  (B4) 
we  can  show  that  G  possesses  a  power  series  at  /i  0,  that 


C-SC,A0(/).  (B5) 

i-0 

A  recursive  formula  for  calculating  <7,  is  obtained  by 
substituting  (B5)  into  (B4)  and  equating  coefficients  of 
powers  of  n. 

G0  ”  ( G0B0  +  pH  2 ) - 1  LqH  ,  Fx ,  (B6) 

G|  +  )  [  ^0^11  —  ^O^uA)]  (B7) 

(7*  ~(C0B0  +  iiH2  )  C*-  |fit  “  Gk~2Fl2L0  —  L»FnGk_2 


k- 3  -1 

~  2  GjF{2Gk_j_}  for  A:  >2  with  2  *0.  (B8) 
y-o  ;-o 
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NEAR-OPTIMAL  FEEDBACK  STABILIZATION  OF  A  CLASS  OF 
NONLINEAR  SINGULARLY  PERTURBED  SYSTEMS* 

JOE  H.  CHOW+  and  PETAR  V  KOKOTOVIC* 

Abstract.  A  new  senes  expansion  method  is  developed  for  a  class  of  nonlinear  singularly  perturbed 
optimal  regulator  problems.  The  resulting  feedback  control  is  near-optimal  and  can  stabilize  essentially 
nonlinear  systems  when  linearized  models  provide  no  stability  information.  The  stability  domain  is  shown  to 
include  large  initial  conditions  of  the  fast  variables.  The  control  law  is  implemented  m  two-time-scaies.  with 
the  feedback  from  the  fail  state  variables  depending  on  slow  state  variables  as  parameters.  The  coefficients  of 
the  formal  expansions  of  the  optimal  value  function  are  obtained  from  equations  involving  only  the  slow 
variables. 


I.  Introduction.  Compared  with  the  rich  literature  on  linear  regulator  theory, 
publications  dealing  with  feedback  design  of  nonlinear  systems  are  a  small  minority. 
Realistic  approaches  to  the  difficult  nonlinear  feedback  control  problem  usually 
exploit  properties  of  special  classes  of  systems  to  develop  approximate  methods  [1]. 
[2].  The  approach  in  this  paper  exploits  multiple  time  scale  properties  of  a  class  of 
nonlinear  singularly  perturbed  systems  [3],  [4]  to  achieve  stabilization  and  near¬ 
optimality.  The  stabilization  results  obtained  are  essentially  nonlinear  in  the  sense  that 
they  also  apply  to  the  critical  case  when  linearized  models  provide  no  stability 
information.  Due  to  a  separation  of  time  scales,  the  proposed  design  procedure  is 
applicable  to  higher  order  systems. 

The  problem  considered  is  to  optimally  control  the  nonlinear  system 

(la)  x  ~ a\(x)+ A\(x)z  +  B\(x)u.  .r(0)-xn. 

(lb)  nz  ~ <h(x)+A2(x)z +Bt(x)u,  z(0)*zo, 
with  respect  to  the  performance  index 

(2)  [p{x)+s'(x)z  +  z'Q(x)z  +u'R(x)u]  dt, 

where  m  >0  is  the  small  singular  perturbation  parameter,  x,  z  are  m  -  dimensional 
states,  respectively,  u  is  an  /• -dimensional  control  and  the  prime  denotes  a  transpose. 
It  is  assumed  that  there  exists  a  domain  D  c  R"  containing  the  origin  such  that  for  ail 
x€D  and  z  €  Rm  the  problem  satisfies  the  following  assumptions: 

I.  The  functions  a i,  <Ji,  Au  Az,  B\,  Bz,  p.  s,  q  and  R  are  differentiable  with 
respect  to  x  a  sufficient  number  of  times  and  a\,  az,  p  and  s  are  all  zero  only 
at  x  *0. 

II.  The  matrices  G(x)and  R(x)  are  positive  definite,  that  is,  C?(x)>0.  R(x)>0. 
Furthermore,  the  scalar  function  p  *-s'z  +  zQz  of  x  and  z  is  positive  definite 
in  both  x  and  z. 

III.  For  every  fixed  x  sD 

(3)  rank  [S;,  AzBz,  ■■■  .  A?"  S:|  -  m 


*  Received  by  the  editors  December  2S.  !9"b,  and  :n  revised  form  September  I  J.  |d7r  This  work  was 
supported  in  part  by  the  National  Science  Foundation  under  Cram  ENG  7-t-20fWI.  m  part  by  the  Energy 
Research  and  Development  Administration  under  Contract  U  S.  ERDA  Ei49-|X)-2()88.  and  <n  part  by  the 
U  S.  Air  Force  under  Grant  AFOSR  "'3-2JTO 

*  Coordinated  Science  Laboratory  and  Department  of  Electrical  Engineering.  L'niversnv  of  Illinois. 
CJrbana.  Illinois  n  1 301 


NEAR  OPTIMAL  FEEDBACK  STABILIZATION 

and  hence  Ai{x)  is  assumed  to  be  nonsingular.  (If  not,  then  using  u  -  u  -t- 
K(x)z  such  that  A2+B2K  is  nonsingular  we  redefine  the  problem.) 

Assumptions  I  and  II  establish  that  the  origin  is  the  desired  equilibrium  of  (1). 
Assumption  III  and  Q(x)> 0  simplify  the  derivations.  Alternatively  a  less  restrictive 
stabilizability-detectability  condition  can  be  used. 

Finite  time  trajectory  optimization  problems  for  the  same  class  of  systems  have 
been  treated  in  [3],  [4]  via  singularly  perturbed  two  point  boundary  value  problems 
originating  from  necessary  optimality  conditions.  The  resulting  controls  are  open-loop 
and  require  boundary  layer  correction  terms  at  both  ends  of  the  interval.  For  the 
infinite  time  regulator  problem  considered  here  the  Hamilton-Jacobi-Bellman 
sufficiency  condition  is  more  suitable  since  it  readily  incorporates  stability  require¬ 
ments  and  leads  to  feedback  solutions.  Using  this  condition  we  obtain  near-optimal 
stabilizing  controls  in  feedback  form  and  avoid  explicit  treatment  of  boundary  layer 
phenomena. 

Our  procedure  is  based  on  a  nested  power  series  expansion  of  the  optimal  value 
function  in  z  and  /x.  An  advantage  of  this  procedure  is  that  it  uses  lower  order 
equations  involving  only  the  slow  variable  x.  In  applications  truncated  series  are  of 
interest.  Stabilizing  properties  of  various  truncated  designs  are  discussed  and  an 
explicit  estimate  of  the  stability  domain  is  given.  It  is  of  practical  importance  that  this 
domain  encompasses  large  initial  disturbances  of  z(0).  Furthermore,  near-optimality 
of  these  truncated  designs  is  established  in  terms  of  O(fx),  0(ix\  etc.  A  particularly 
useful  result  is  that  an  0(tx)  near  optimal  feedback  control  can  be  implemented 
without  knowing  the  value  of  the  small  parameter  y.. 

The  paper  is  organized  as  follows.  In  §  2  a  reduced  order  problem  is  formulated 
for  the  slow  variable  x.  The  crucial  assumption  is  that  the  properties  of  its  solution  are 
known.  Using  a  truncated  expansion  of  the  optimal  value  function  the  so-called 
composite  control  is  introduced  in  §  3.  Since  the  leading  term  in  the  series  is  the 
optimal  value  function  of  the  reduced  problem,  the  original  probiem  is  well  posed.  In 
§  4  it  is  shown  that  the  composite  control  guarantees  a  finite  domain  of  stability  for  the 
resulting  feedback  system.  In  §  5,  a  formal  expansion  of  the  optimal  value  function  is 
proposed  and  near-optimality  results  are  discussed.  An  example  is  discussed  in  §  6. 

2.  The  reduced  control.  In  singular  perturbation  techniques  [5],  a  problem  for 
the  full  order  system  (1)  where  ^  >0  is  interpreted  as  a  perturbation  of  a  reduced 
problem 

(4a)  x  »a1(x)+Ai(x)z+Sl(x)«,  *(0)  =  xo 

(4b)  0*aI(x)+A:(x)z-^S:(x)u, 

in  which  ix  *0.  Due  to  assumption  III.  z  can  be  solved  from  (4b)  and  eliminated  from 
(4a)  and  (2).  Then  the  reduced  problem  is  to  optimally  control  the  system 

(5)  x»au(x)+£0(x)u.  x(0)=xo 

with  respect  to 

(6)  /0»J  lPo(x)*2soix)u*u'R0(x)u]dt. 

where 

<2o  =  C  i  —  A  |  A  ;  3 .  Bn  *  B\  ~  A  i  A  ;  1 B2, 

pUmP~sAz  So  »  S;A;  1  ((?A;  1  a2  —  ), 

Ro^R^BzAi  QA-, '  B2. 


(7) 
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The  origin  x  •  0  is  the  desired  equilibrium  of  the  optimally  controlled  reduced  system 
(5)  for  all  x  e  D,  since,  in  view  of  assumption  II,  a<j(0)  ■  0  and 

(8)  po(x  )  +  2s'q(x)u+u'R0(x)u 
is  positive  definite  in  x  and  u. 

The  reduced  problem  (5),  (6)  is  considerably  simpler  than  the  original  problem 
(1),  (2)  because  of  the  elimination  of  the  fast  variables  and  the  reduction  of  the  system 
order.  One  of  the  tasks  of  the  singular  perturbation  analysis  is  to  establish  whether  the 
full  problem  is  well-posed  in  the  sense  that  its  solution  tends  to  the  solution  of  the 
reduced  problems  as  p.  -*  0.  If  so,  then  the  next  task  is  to  deduce  the  properties  of  the 
original  problem  from  the  properties  of  the  reduced  problem.  Finally  these  properties 
are  to  serve  as  a  basis  for  a  simplified  design  procedure. 

To  formulate  our  basic  assumption  about  the  properties  of  the  solution  of  the 
reduced  problem  we  use  the  optimality  principle 

(9 )  0  -  mi  n  [po(x ) + 2s i  (x  )u  +  u '  £0( x  )u  -  L ,  (ao(x )  +  Sq( x  )u  )] , 

where  L  is  the  optimal  value  function  and  L,  is  its  partial  derivative  with  respect  to  x. 
This  yields  the  minimizing  control 

(10)  uo- -Rol(so  +  ±BoL,) 

whose  elimination  from  (9)  results  in  the  Hamilton-Jacobi  equation 

(11)  0*(p<j  — so/?o  Sq)+ L,(<Xo~‘ BqRo  so)- *L.tBoRo  L(0)m0. 

Note  that,  due  to  (8),  p0 -SqRo  lSo  is  positive  definite  in  D  Our  crucial  assumption  is 
then  stated  as  follows. 

IV.  The  unique  positive  definite  solution  l(x)  of  (1 1)  exists  in  D  and  is  differen¬ 
tiable  with  respect  to  x  a  sufficient  number  of  times.  Furthermore  the  level 
surface  L  *  c0  *  constant  is  taken  to  be  the  boundary  of  the  set  D. 

In  the  special  case  considered  in  (1),  where  the  linearization  of  (5)  at  x*0  is 
stabilizable  and  its  states  are  observable  in  the  quadratic  approximation  of  /0.  our 
assumption  IV  is  automatically  satisfied  for  all  x  near  the  origin.  It  follows  from 
assumption  IV  that  u0  is  the  unique  optimal  feedback  control  for  the  reduced  problem 
and  L  is  a  Lyapunov  function  of  the  optimally  controlled  reduced  system 

(12)  x  m  ao  —  BnRo 1  {so  +  tBoL't)  m  &q(x), 

establishing  that  the  origin  is  asymptotically  stable  and  the  set  D  belongs  to  its  domain 
of  attraction. 


3.  The  composite  control.  The  optimal  value  function  V (x.  z.  p )  of  the  full 
problem  £1),  (2)  satisfies  the  equation 


(13) 


0  *min  +  +  z'Qz  +  u'Ru  +  V,(ai  +•  t B\u) 

+  —  V,(a-  +•  Azz  +  S:u)1. 

M  J 


where  Vt,  Vt  denote  the  partial  derivatives  of  V'  with  respect  to  the  variables  x,  c. 
respectively.  The  minimizing  control  of  (13)  is 


(U) 


«-  v;— -b'2v.). 

2  '  n  / 
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and  its  substitution  into  (13)  yields  the  Hamilton-Jacobi  equati  n 


(15) 


0*  p+s'z  +z'Qz  t  Vx(a\ -»-Aiz)+—  Vt(<*i  +  Azz) 

M 


"  j(  V'B> v«52)^  *1(b  i  v;  +-fli  v;),  v(o.o.  *)»<>. 


Since  system  (1)  is  linear  in  z  and  J  is  quadratic  in  z,  and  since  z  is  mi'Liplied  by 
M.  we  seek  a  solution  of  (13). in  the  form 

V(x.  -,m)“  Vo(x)+n&\(x)2 +hz"Pi(x)z +nq(x.  z.n) 

■  ?(X,  Z,ti.)  +  /M?(x,  z,n),  Vo(0)-0 

where 


(17) 


dq/dx»0(  1),  dq/dz  *  0(/x). 


We  shall  investigate  the  expansion  of  q  in  a  later  section.  The  partial  derivatives  of  V 
with  respect  to  x,  z  are 


(18) 


V.-9o  i+0(ix), 

Vt*nV[  -t-2 Mr'?:  +  0(M:). 


Substituting  (18)  into  (13)  and  neglecting  the  n -dependent  terms,  we  obtain  the 
equation 

0  -  p  +  V0x a t  +  V\ az  - i(  +  P'.fl,)*  “ ’ 1  (B\  ?o,  +  Sj  V\ ) 

(19)  +  (s'  +  2ai  V%  +  VoAAx-BxR"Bi  <?:)+  17;  (A:  -  Sj/T 'Si  P,))r 
-►  z'(Q  +  ?:  A  2  +  Ac  ?2  -  VzBzR'lBz  Vz)z. 

In  order  to  satisfy  (19)  identically  for  all  z,  we  require  that 

(20)  0-p+ ^taa,+  ^'l«j-i(^taSi  +  ^'A)/?"l(S'i^i.+fl*^tX  ?o(0)-0, 

(21)  0-s‘  +  2ai^:4-  V^A, V;)-^  V\(AZ-BZR"  B'ZV:), 

(22)  Q~Q+VzAz  +  AiVz-VzBzR’'BzVz. 

At  each  fixed  value  of  x,  (22)  is  an  algebraic  Riccati  equation  for  Vz.  In  view  of  (3)  and 
Q(x)>0,  the  unique  positive  definite  solution  Vz  exists  such  that  for  all  x  s  D.  the  real 
parts  of  the  eigenvalues  of  Az»  Az- BZR~XB'ZVZ,  denoted  by  Re(A(A2)},  are  less 
than  a  negative  constant.  Thus  A  2  is  nonsingular  and  VK  can  be  expressed  in  terms  of 
Vox  and  Vz  as 

(23)  9\  ■  —[s’  +  2a'zVz  +  Vo,(Ai  —  fli/?"lfl'2^i)jA"1. 

It  is  of  crucial  importance  that  the  elimination  of  V'i  from  (21)  results  in  an  equation 
involving  only_V0„.  For  the  well-posedness  of  the  full  problem  it  is  necessary  that  the 
leading  term  V^o  of  (16)  be  identical  to  the  solution  L  of  the  reduced  problem. 

Lemma  1.  If  assumptions  III  and  IV  are  satisfied,  then  the  unique  positive  definite 
solution  Vr>(x)  of  (20M22)  exists  in  D  and  is  identical  to  the  solution  L{x)ofthe  reduced 
problem  (5),  (6). 

Proof.  It  is  shown  in  the  appendix  that  eliminating  V\  from  (20).  we  obtain  the 
Hamilton-Jacobi  equation  (11)  with  V,„  in  place  of  L„  and  hence  Vu(x)«L(x)  with 
properties  as  in  assumption  IV, 
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By  virtue  of  Lemma  1.  V0  and  are  solved  independently  from  (11)  and  (22). 
This  is  the  separation  of  time  scales  in  the  design  of  nonlinear  regulators,  analogous  to 
the  linear  time-invariant  design  in  [7], 

Using  V.  we  derive  the  control 

(24)  -  - */? -‘[Bi  * 2  ?:z )\*0(m) 

•Uc  +  CHjl), 

whose  main  part  u«  is  defined  as  the  composite  control.  Eliminating  V^i  from  (24)  using 
(23)  and  following  the  derivation  in  (7],  we  can  write  u,  as 

Uc  -  -  Ro 1  (So  +  ?o, )"  R  " [B:  9,[z  +  A?  (a,  -  So^o 1  (so  +  * 56  V'0, ))] 

•  uo-R~lB'tVi(z+AV<h), 

Aj(x) * Aj  —  BZR  'SjV'1’., 

di(x )  •  «,  -  kBiR  "(B\  V'o.  +  fli  P, ),  d:(0) »  0. 

Hence  the  composite  control  u*  consists  of  a  slow  control  uQ  which  optimizes  the 
reduced  system  (5)  and  a  fast  control  - R~lBz  &z(z  +  A~ldj)  which  optimizes  the  fast 
part  (z+A~‘ii)  of  z  in  the  sense  that  satisfies  (22).  Note  jhat  when  z  is  not 
penalized  in  (2).  that  is  when  Q(x) »  0,  but  Re  {A  (Ai)\  <  0,  then  V2  is  identically  zero 
and  Uf  reduces  to  u0  of  (10).  Stabilizing  properties  of  the  composite  control  uc  are 
established  in  the  next  section. 


(25) 

where 

(26a) 

(26b) 


4. 


(27) 


Stabilizing  properties.  System  (1)  controled  by  ue  is 

x  »a{+AxZ  +Biutm&l(x)-rAt(x)z,  x(0)«xo, 
fiz  m  ai  +  AiZ  +Biue  •di(x)-*‘Ai(x)z,  z(0)-z0. 


where 

d,  •al-lBiR-l(B'lV’0t  +  5:?,).  ii(0)-0. 

(28)  „  .  . 

Ai-At-BiH  ‘SjVj. 

With  the  change  of  variables 

(29)  n -*  +  *?’«* 

exhibiting  n  as  the  fast  part  of  z,  system  (27)  becomes 

(30a)  x-do+Ain,  x(0)*xo. 


HV  *M(Ar'di),do  +  (A:-t-M(Ai'ii),Ai]Tt 

(30b) 

*  nf{x )  +•  ( .4  2(x )  +  nF(x  )]tj,  n(0) »  z0  A :  (xo)di(xo). 

Since  the  right-hand  side  of  (30b)  is  an  0(/u)  perturbation  of  A2(x)tj  and  Re  {A(A;)}< 
0  in  D  we  expect  that  77  will  rapidly  decay  to  an  O(n)  quantity.  This  motivates  the 
introduction  of 


(31) 


U{x,  K(x)  +  Zrj'Vz(x)v. 
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as  a  tentative  Lyapunov  function  for  (30).  Here  if  is  a  small  oosit've  scalar  to  be 
determined.  From  assumptions  III  and  IV,  P0(x)  is  positive  dennit.  ’d  V2(x)>0  in 
D.  Hence  1/  is  positive  definite  for  all  xs  D  and  v  e  Rm.  Furtt  more,  since 
V0(x )  ■  co  >  v  for  all  x  on  the  boundary  of  D,  the  surface 

(32)  S(*.n;?)-{xrj:C/(x.n;*)»Co} 

is  closed  in  the  (n  +  m  )-dimensionai  domain  xeD,  rteRm.  We  define  to  be  the 
domain  in  the  interior  of  S. 

Let  D\  be  a  set  strictly  in  the  interior  of  D,  that  is,  the  boundary  of  D  'oes  not 
intersect  the  boundary  of  D,  and  let  £  be  a  bounded  set  in  Rm.  The  presence  i  f  a  in  U 
extends  5  to  encompass  {x,  z)  for  all  rsDt  and  for  z  in  any  prescribed  set  £.  This 
crucial  result  is  stated  as  follows. 

Lemma  2.  If  assumption  III  and  IV  are  satisfied ,  then  there  exists  an  if  >  0  such 
that  the  domain  S,„  contains  all  x  s  Du  r?  €  £. 

Proof.  At  each  point"  x  sDi,  the  projection  S  onto  the  n  subspace  is  the  ellipsoid 

(33)  T,'V2(x)v~(ca-Va(i))/%. 

implying  that  rj  extends  to  0(  l/v£).  Hence  for  every  x,  there  exists  an  tf(x) 
sufficiently  small  such  that  the  ellipsoid  (33)  includes  all  rj  s  E.  (Note  that  we  must 
exclude  the  boundary  of  D  because  from  (33)  the  projection  of  5  at  any  point  on  the 
boundary  of  D  is  a  single  point  n  »  0.)  Hence  if  we  choose  it*  to  be  the  smallest  of  such 
&(x).  the  domain  5in  contains  all  x  €  D t,  v  e  E  for  any  ft  e  (0,  ?*]. 

By  virtue  of  Lemma  2,  the  initial  condition  tj(0)  of  (30b),  and  hence  z(0)  of  (27). 
can  be  as  far  away  from  zero  as  O(Nf)  and  still  be  enclosed  by  S.  We  now  examine 
the  relationship  between  ?  and  u- 

Using  (11),  (22)  and  rearranging,  we  obtain  the  time  derivative  of  U  with  respect 
to  (30)  as 

(34)  £/-  -g(x,  9,n)~fQ(x)f--ii'\t(x.  V,  tt.a'h 

2a  a 

where 

gmgi-^y'Q~ly,  gi  ~ po- soRl' so+IVomBoRo1  B'qV'0„ 

(35)  yA'tVo.+29Vtf. 

M  -  ?zB2R ’lB'z  Pj  -  a(  Vif  +  P  ?:) -a  K 

Since  ViFz  +  F" ’Vz  and  &z  are  bounded  for  all  x,  17  in  5 i„,  and  since  Q(x)>0  in  D.  it 
follows  that  there  exists  a  a*  >0  such  that  M  >0  for  ail  x,  rj  in  S,n  and  for  a  s  (0.  m*1- 
Thus  the  last  two  terms  in  Cl  are  positive  definite.  To  ensure  that  g(x.  t,  a )  is  positive 
definite,  we  assume  that  the  reduced  problem  also  satisfies 
V.  The  limit 


(36) 


lim 

gi 


exists  for  all  fixed  t  >0. 
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Note  that  k  SO  because  y'Q~ly  is  positive  semidefinite  and  gi  is  positive  definite.  The 
limit  (36)  implies  that  there  exists  a  domain  Z5  about  t»0  such  that 

(37)  y'Q~'y  S(l  +  Jfc)flt 

that  is.  such  that  for  p.  <2?/(l  +  lc),  g  is  positive  definite  in  f5;  see  (35).  Let  £(?)>0be 
the  minimum  value  of  gi  on  the  boundary  of  £>.  Hence  in  the  domain 

(38)  5,(r)-{r:f.(r)<a 


g  is  positive  definite.  On  the  other  hand,  since  D  is  bounded,  there  exists  a  fct(Sf)>0 
such  that  y'Q~ly  <  k{  for  all  x  s  D,  that  is,  such  that  g  is  positive  definite  when  x  is  not  in 
the  domain 


(39)  5(  *)-{*:gi(x)<M*I/2f} 

about  the  origin.  But  for  p.  <  IKIc/ki,  /5  c  implying  that  g  is  positive  definite  in  D. 
Thus  0  is  negative  definite  for  ail  x,  17  contained  in  Si„.  We  now  conclude  that  U  is  a 
Lyapunov  function  for  (30)  guaranteeing  that  x  ■  0,  n  *  0  is  asymptotically  stable  for 
all  xsD t,  and  for  p.  s  (0.  *i*].  where 


(40) 


.  /  2?  2*£ 
,mmlr Tk'  TP*1) 


Returning  from  the  if  variable  to  the  z  variable  via  z  •  77  -  A? ldj,  we  obtain  for 
all  x  6  D\.  v  €  £  a  corresponding  bounded  domain  £t  for  z.  We  summarize  the  above 
discussions  on  the  asymptotic  stabilizing  property  of  u*  in  (24)  as  follows. 

Theorem  1 .  If  assumptions  I-V  are  satisfied .  then  there  exists  a  p  *  >  0  such  that  for 
all  pt  (0,  m*I  and  for  all  xeDi  and  z  in  any  prescribed  bounded  set  £l(  the  origins  *0, 
z  »  0  of  the  feedback  system  (1)  controlled  by  the  composite  control  uc  is  asymptotically 
stable. 

Theorem  l  can  be  applied  in  two  different  directions.  As  outlined  above,  for  any 
given  D,  and  £t>  we  first  find  ft*  such  that  5i„  of  (32)  contains  ail  xeDt,  ze  £1.  Then 
we  find  p  *  from  (40).  This  direction  is  suitable  when  p  is  a  parameter  at  the  designer’s 
disposal,  such  as  a  gain  factor  [9].  In  the  other  direction,  if  p  represents  some  given 
physical  parameters,  such  as  time  constants,  we  use  its  value  to  determine  the  smallest 
W  such  that  U  of  (34)  is  negative  definite,  that  is  we  find  the  largest  D 1  and  £|. 

As  a  special  case  of  assumption  V,  consider  that  the  origin  x  -  0  of  the  reduced 
system  (12)  is  exponentially  stable.  Then  near  the  origin,  p0  -JoRo  l*>,  &o  grow  as  |x|2, 
and  ;v^o«i,  idol  grow  as  |x{,  and  we  can  find  positive  constants  Jfcj,  ••  • ,  fc*  and  S  such 
that 


*:|x|J Sp0-Jo£olJoSlcj|x|J,  fc4|x|Ji  VoZkslxl1 
fc*jxj  2 1  V0t\  2  k?\x\,  kt |x|  %  Idol  s  k9\x\ 


for  all  |x|  <  S.  It  follows  from  (41)  that  there  exists  a  fixed  fe  io(^)  >  0  such  that 
(42)  y’0''y  SS^ioUl2 

and  the  limit  (36)  is  bounded  by 


(43) 


y'Q~'y^  *iolxj2  kH, 

lim  - S  lim  — — r*-— 

g  1  k: |x|“  k: 


satisfying  assumption  V. 

In  this  case  a  claim  stronger  than  Theorem  1  can  be  made. 
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Corollary  1 .  If  assumptions  I-I V  are  satisfied  and  the  origin  x  »  0  of  the 
reduced  system  is  exponentially  stable,  then  the  conclusion  of  Theorem  1  holds  and 
moreover  the  origin  x«0,:«0o/  (27)  is  exponentially  stable. 

Proof.  The  first  part  of  the  corollary  follows  from  Theorem  1.  The  second  part 
follows  from  the  linearization  of  (27)  at  the  origin 


(44) 


'  Mi(0) 
dx 

1  3d:(  0) 
ji  dx 


The  system  matrix  of  (44)  has  one  group  of  n small  eigenvalues  0(p.)  close  to  those 
of  (ddi/dx )  -  A  : 1  (ddi/dx  )U  .o  and  another  group  of  m  large  eigenvalues  0(1) 
close  to  those  of  (l/VjA-fO)  [8].  But  d, -AiAJld2  *  d0  and  (ddjd x))x-u* 
(ddifdx)-Ai  >\2l(3di/dx)|,_o  as  di(0)«0.  Thus  the  real  parts  of  the  eigenvalues  of 
the  system  mate/  of  (44)  are  all  negative  and  x  *  0,  r  »  0  is  exponentially  stable. 

If  the  origin  x  *  0  of  the  reduced  system  is  only  asymptotically  stable  but  not 
exponentially  stable,  then  in  general  g  need  not  be  positive  definite  for  all  xsD.  This 
situation  includes  the  critical  case  when  the  linearized  model  does  not  provide  any 
stability  information  as  clarified  by  the  example  in  §  6.  For  this  situation  the  system  is 
now  shown  to  possess  a  weaker  stability  property,  that  is.  its  trajectories  tend  to  a 
small  sphere  around  the  origin.  Define  the  domain  in  R " 


(45)  p(x)»{x:g(x; 

which  is  contained  in  the  domain  D  of  (39).  Due  to  the  presence  of  m  in  (34).  0  may 
be  positive  only  if  x  ep(x)  and  rj  ■  0(jm).  Otherwise,  U  is  negative.  If  we  define  the 
surface 


(46)  ir(x,  x)«{x,  z  :xsp(x;u),  z  -  -A£l(x)d:(x)} 

about  the  origin  in  Rm'"',  ue  defined  by  (24)  is  a  stabilizing  control  in  the  following 
sense. 

Theorem  2.  If  assumptions  I-I  V  art  satisfied,  then  there  exists  a  u*>  0  such  that 
for  all  fjL  €  (0,  ***],  the  feedback  control  (24)  steers  all  x  e  Du  ts£  i  of  the  full  system 
O(fi)  close  to  the  surface  tr(x,  z). 

Proof.  Since  U> 0  and  U <  0  except  for  x  € p(x)  and  rj  *  0(m ).  x  converges  to 
p(x)  and  v  decays  to  an  O(p)  quantity.  Thus  in  the  x,  z  variables,  (x.  x)  converges  to 
an  0{ji)  neighborhood  of  the  surface  ir(x,  z). 

In  the  case  where  the  fast  transients  of  z  in  (1)  are  exponentially  stable,  that  is. 
Ai(x )  is  stable  for  all  x  €  D,  and  we  are  only  concerned  with  the  optimality  of  the 
reduced  system  (5),  then  the  r -independent  reduced  control  Uo  of  (10)  stabilizes  the 
full  system  (1)  with  essentially  the  same  stabilizing  properties  as  u*  of  (24).  We  shall 
not  repeat  the  argument. 

An  attractive  feature  of  the  controls  ut  and  u0  is  that  they  do  not  require  the 
knowledge  of  the  actual  value  of  u  provided  that  it  is  sufficiently  small.  When 
appropriately  implemented,  these  controls  stabilize  the  full  system  (1)  and  achieve 
optimality  of  the  reduced  system,  and  in  the  case  of  ut,  also  optimality  of  the  fast  part 
of  :.  The  above  results  also  answer  the  question  of  well-posedness  by  giving  the 
conditions  under  which  the  same  optimal  reduced  order  system  is  obtained  when  a  is 
set  equal  to  zero  either  when  system  (l)  is  uncontrolled  or  when  it  is  controlled  by  uc 
or  uo.  In  contrast  to  many  other  singular  perturbation  results  which  require  u  to  be 
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sufficiently  small,  this  section  provides  a  method  to  compute  an  estimate  of  allowable 
values  of  m  given  a  stability  domain  or  vice  versa. 

5.  A  formal  expansion  and  near-optimallty.  The  equation  (16)  only  satisfies  the 
Hamilton-Jacobt  equation  (15)  to  O(m)  order.  We  now  propose  to  solve  (15)  by 
expanding  V  formally  as  a  nested  infinite  power  series.  If  this  power  series  is  con* 
vergent.  then  the  optimal  solution  V  of  (15)  exists.  For  x,  z  near  the  origin,  it  has  been 
shown  in  [1]  that  the  optimal  solution  exists  and  possesses  a  power  series  expansion 
when  system  (1)  after  linearization  at  the  origin  is  stabilizable  and  the  state  in  the 
quadratic  approximation  of  J  is  observable.  Here  we  are  interested  in  a  power  series 
of  V  which  satisfies  (15)  to  any  order  of  m- 

Since  system  (1)  is  linear  in  z  and  J  is  quadratic  in  z,  the  optimal  value  funcu.n 
can  be  expanded  as  a  power  series  in  the  components  of  z  [2].  In  addition,  since  z  is 
the  fast  variable,  the  z  terms  in  the  optimal  value  function  are  multiplied  by  appro* 
priate  powers  of  ix  (5].  In  view  of  these  two  characteristics,  we  seek  a  solution  of  (15) 
in  the  form 

V(x,  z,  n)«  v0(x,  n)  +  M  I  V'ui*.  /a)x,  +  m.  I  I  Vj*(x,  U.)z,zk 

l-l  /-Llr-I 


(47) 


+  I  I  Vhlu,(x.  ^)z,zkz,  + 

/- 1  k-l  «-l 


Z  Z  ‘  *  Z  Viiur  ’  ‘  * 

/i-t/j-l  /*•! 

V„(0.**)«0. 


where  Viixn...u  is  the  (ji,j2,  •  •  ■ ,/))  element  of  the  completely  symmetric  generalized 
matrix1  V,  of  dimension  m‘  and  z,  is  the  /th  component  of  z.  The  summation  signs  in 
(47)  and  in  other  equations  in  the  paper  will  be  omitted  when  there  is  no  confusion  as 
to  which  indices  /(,/;,■■•,/.  are  being  summed.  The  partial  derivatives 
V„  Vtl,  •  ■  ■ ,  VZm  expressed  in  terms  of  the  vector  x  and  the  scalars  •  •  •  ,  zm  are 

(48a)  V,  »  V0,  +ju.Vt/,c,  +ixVilkxz,Zk  +  •  •  • 

(48b)  Vti  »tiVu  +2mV:,(z,  +3nlVwzlzk+  ■■  ■  ,  i  »  1,  2.  •  •  • ,  m. 

where  the  summation  signs  over  /,  k  are  omitted. 

For  the  series  (47)  to  satisfy  (15)  as  an  identity,  we  first  rewrite  (15)  in  terms  of 
the  vector  x  and  the  scalars  zit  ■  ■  ■ ,  zm. 


(49) 


0  ■  p  +  s,Zi  QtfZj,  +  V,  (a  t  +•  A  l(Zj ) + —  V,,  (a2l  A  2„z, ) 

n 


-l(V‘Bx+^KBzl)R-l(B'xV't 


where  sit  a2t  are  the  ith  components  of  the  vectors  s.  a2,  respectively,  Au  is  the  ith 
column  of  the  matrix  At,  B2,  is  the  ith  row  of  B2,  Q,„  A2ii  ire  the  (i,  /)  elements  of  Q, 
A  j,  respectively,  and  the  summation  signs  over  the  indices  i.  j  are  omitted.  Then,  upon 
substituting  (48)  into  (49)  and  equating  the  coefficients  of  the  like  powers  of  z„  we 


1  The  (/„  jj.  •  .  /,)  elements  of  V,  are  identical  for  ail  permutations  of  the  indices  ■  .  /,  (61. 
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0 -p  +  V0tat  +  -i(V0x5t  +  VUBZ,)R-\B\  V'0t  +B'i,Vu), 

Vo(0.M)-0, 

R‘l(jzB\  V'u,  +  2B'V  Vw).  «  - 1. 2.  •  • .  m, 

0  ■  Qt,  +m  i  +  m(  1/ )» +■  2(  VukAikt ),  +  3/u  Viuk&ik 

-&V<imBl  +  VlkB2k)jr'Wl  V'w.  +3MSi,Vw) 

-i(MVt»B,+2  VwAatf'Wt  V\*  +  2Bv,Vv,). 

i,  j  »  1,  2,  •  •  • ,  m. 

0  *  M 1  Vjmu&  i  ■*"/*(  Vw*A  t  *  )*  +•  4ji 2  Viiiktait  +  3  /*  ( V j,* ), 

-hV'o.B,  +  V'1<^1<1)/?*,(M2fl'lV'Ji,4ut  +4MJBi,V'4i(*4) 

4-2  v^j^/rWt  /U  +  WuVu,k)),. 

i, /,  k  •  l,  2,  •  •  • .  m, 

where  the  right-hand  sides  of  (50a),  (50b),  (50c),  (50d),  •  •  • ,  are  the  coefficients  of  the 
^-independent  terms  and  of  the  r„  :,z„  z,z,Zk,  •  •  • .  terms,  respectively.  Because  of 
symmetry,  there  are  m(m  + i)/2  equations  in  (50c),  m(m  +  l)(m  +2)/ 6  equations  in 
(50d)  and  in  general,  dXk~J0  (m  Tlc))/i!  equations  when  the  coefficients  of  r„z(J  •  ■  • 

/i,  /:.  •  •  •  .  /j  *  1,  2,  •  •  •  ,  m.  are  equated. 

For  a  simplified  treatment  of  these  equations  we  now  exploit  the  presence  of  the 
small  singular  perturbation  parameter  m-  We  expand  each  coefficient  of  (47)  as  a 
power  series  in  y.: 

(51)  V,(x,pO«  £  *'V’(x),  i-0,  1.2. 

/-o 

where  the  boundary  condition  of  Vq  is  Vo(0)»0.  /«0,  1,  2,  •  •  •  .  The  expressions 

(5 1 )  substituted  into  equations  (50)  are  to  satisfy  them  as  identities  in  y..  Equating  the 
coefficients  of  the  like  powers  in  y,  we  generate  sets  of  equations  for  V',  i,  j  » 
0, 1, 2,  •  •  • .  The  first  set  of  equations  obtained  by  equating  the  y -independent  parts  in 
(50a),  (50b),  (50c),  are  precisely  equations  (20),  (21).  (22).  respectively.  Hence  from 
the  uniqueness  of  solutions  to  (20),  (21),  (22),  conclude  that 

(52)  V%-90 V?  -  Vx,  Vi-?,, 

and  V  thus  consists  of  the  leading  terms  of  V. 

The  second  set  of  equations  in  matrix  form 

(53a)  0-Oi  +  ^ii.  V^(0)-0. 

(53b)  0-  V^At  +  d'i V'f,  +  V\ ’M  +  ia'iVl 

(53c)  0-  V0ud{+l{V°lxAl+A\V<(,)+V\Ai  +  AiV\  +3(V°d;). 


obtain 

(50a) 

(50b) 

(50c) 

(50d): 


5  The  subscript  j  denotes  the  symmetrization  operation  of  generalized  matrices  (6).  For  example. 

( '''j, k^ik, )«  ■  f(  V:,kA  j»,  *  ) 
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(53d)  0-3(V?A:),+(Vl,Al)« 

obtained  by  equating  the  p  terms  in  (50a),  (50b),  (50c),  (50d),  respectively,  involve 
only  the  unknown  terms  Vo„  V{,  V\  and  Vj.  In  (53)  the  multiplication  of  an 
*i  x  x  matrix  by  an  njX«4  matrix  results  in  an  *,  x  x  n*  matrix.  For  con¬ 
venience  we  suppress  the  last  dimension  of  the  m  x  m  x  l  matrices  ( V\ ,d\)  and  ( V?d:) 
and  regard  them  as  m  x  m  matrices.  Since  Az  is  stable,  (53d)  and  (53c)  can  be  solved 
sequentially  for  V\  and  V[,  respectively.  Then  V\  can  be  solved  from  (53b)  and  its 
substitution  into  (53a)  results  in  the  partial  differential  equation 

(54)  0  -(*',Vf,+2Ji  V\  )A?d2,  W  (0)  -  0. 

In  general,  in  equating  the  terms  we  obtain  the  (i*  l)st  set  of  equations 
involving  the  unknown  terms  V'oM,  V\,  V2,  V‘}~\  ■  ■  • .  The  terms  V'f.,, 
Vl,  •  •  • ,  V;-1  are  solved  for  sequentially  and  then  Vff 1  is  to  be  solved  from  an 
equation  similar  to  (41). 

The  main  accomplishment  of  the  nested  expansions  is  that  the  first  set  of  equa¬ 
tions  (20H22)  can  be  solved  independently  for  the  first  three  zeroth  order  terms  V®. 
V'®  and  v\.  Similarly,  (53)  and  the  subsequent  sets  of  equations  can  be  solved 
independently  for  V‘0,  V\,  •  ■  ■ ,  vf.j.  These  equations  are  dependent  only  on  x  and 
not  on  :  or  n.  A  further  simplifying  property  is  that  at  the  first  stage  the  equations 
(11),  (22)  for  V%  and  Vi  are  decoupled. 

The  approximation  obtained  by  expanding  V  of  (47),  (51)  to  the  ith  set  of 
equations  is  stated  in  the  following  theorem.. 

Theorem  3.  Suppose  that  the  solutions  to  the  i-th  set  of  equations  of  V  exist  and  let 
V'  be  the  truncated  series  of  (47).  (51)  including  all  the  terms  V\  up  to  the  i-th  set.  Then 
the  control 

(55) 

is  near-optimal  in  the  sense  that  V  satisfies  the  Hamilton- Jacobi  equation  (15 )  to  an 
O(p')  error. 

Proof.  Substituting  the  VJ  terms  into  (15)  and  using  the  first  i  set  of  equations  of 
V,  the  coefficients  of  pk  terms,  k  <i,  in  the  resulting  equation  vanish,  implying  0(jjl') 
near-optimality. 

Thus  Theorem  3  implies  that  ue  of  (24)  is  an  O(m)  near-optimal  control  because 
it  is  an  O(p)  approximation  of  ul  which  achieves  0{p)  near -optimality.  In  general, 
retaining  only  the  p'  terms,  k<i.  in  u„  the  resulting  control  also  is  O(m')  near- 
optimal  in  the  sense  of  Theorem  3. 

Repeating  the  derivation  in  §  4,  we  can  show  that  u,  stabilizes  the  full  system  ( l ) 
with  similar  stabilizing  properties  as  uc  of  (24).  We  first  introduce  the  x,  r\  *  z  +  A? ld2 
variables  and  consider  U  in  (31)  as  a  tentative  Lyapunov  function.  The  analysis  is 
more  cumbersome  but  results  similar  to  Theorems  l  and  2  and  Corollary  1  can  be 
established. 

6.  Discussion  and  example.  The  computational  advantage  of  the  proposed  pro¬ 
cedure  is  that  all  the  terms  of  V  in  (47),  (51)  are  obtained  from  equations  involving 
the  slow  variable  x  only.  Moreover  and  V'1’  are  solved  for  independently  Explicit 
consideration  of  the  initial  boundary  layer  is  avoided  and  it  is  optimally  stabilized  by 
the  z  variable  feedback.  Furthermore  using  the  x.  r\  variables  an  estimate  of  the 
domain  of  stability  is  easily  obtained.  Alternatively,  for  a  stability  domain  to  encom¬ 
pass  a  prescribed  bounded  set  17  s  E  -  Rm  a  bound  for  p  can  be  determined 
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Several  aspects  of  the  design  procedure  and  the  stability  properties  of  the  resul¬ 
ting  feedback  system  are  now  illustrated  by  considering  the  optimal  control  problem 
of  the  second  order  system 

(56)  x-xz.  nz»-z  +  u. 


with  respect  to  the  performance  index 
(57) 

Solving  the  reduced  problem  we  obtain  L  ■  V'S  ■  x:  and  u0  “  -x:.  The  optimally 
controlled  reduced  system  (12)  is  x  ■  -x1  and  its  unique  asymptotically  stable  equili¬ 
brium  is  x  « 0.  Note  that  the  linearization  of  the  reduced  system  fails  to  provide  any 
stability  information  at  x  *0.  Let  D  be  the  interval  [-1. 1],  that  is.  L  *c.i*  1  at 
x  *  ±  1  by  assumption  IV.  _ 

The  pair  (Aj,  Bi)m  (- 1.  1)  satisfies  (3)  and  we  can  solve  (22)  for  V\  *i(v'2-  1) 
such  that  A  j »  -  •J2.  Then  the  substitution  of  *  L  m  x:  and  V%  into  (23)  yields  the 
following  expressions  for  (24)  and  (16): 

(53)  ^•-(VirM'/I-Uz). 

(59)  ^•x!-t-Atv/2xJx+Mi('^2-l)z:. 

The  resulting  feedback  system  is 

(60)  i  -  xz,  nz  -  -'fix1- Jiz. 


This  result  is  essentially  nonlinear  since  the  linearization  of  (60)  at  x  »0,  ;  »0 
does  not  provide  any  stability  information.  After  the  change  of  variables  77  »z  ~x:, 
system  (60)  becomes 

(61)  x*-x5-*-xt7,  hv  -{^2-2hx1)v- 

Since  we  require  |xj  S  1,  m  is  restricted  to  be  less  than  l/*  2.  The  tentative  Lyapunov 
function  (31)  is 

(62)  C/(x.n:ir)»x:-t-t(v'2-l)Jfij:. 


If  we  require  that  the  initial  conditions  of  (61)  be  in  |xj  S  .8, 117 j  S  5.  then  we  must  set  ? 
to  be  less  than  .0695  in  order  for  the  ellipse 

(63)  S(x.  n;  »)-{*.  |»  •  u  •  x1 +i(V2-  l)?i»:  -  1} 

to  enclose  these  initial  conditions.  Plots  of  5  in  the  x.  77  coordinates  and  the  x,  z 
coordinates  for  ?  -  .06  are  shown  in  Fig.  1.  The  time  derivative  of  U  with  respect  to 

(61)  is 


(64) 


where 

(65) 


g,-2x*.  y  »2(l-?(v/2-l)x:)xJ, 


M 


2m(v'2-1)x:. 


Since  lim,_»  y:/gi  *  2.  assumption  V  is  satisfied.  For  ail  x.  77  in  the  interior  of  5  and 
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—  ■  -  x,  n  coordinates 
- x.z  coordinates 


Fig.  1.  Plot  ofS  i n  (63). 


4  *  .06,  U  is  negative  definite  for  ait  n  s  (0.  .03].  Hence  x  »  0,  zj~  0  is  asymptotically 
stable  for  all  |x| 2  .8,  \z  +x!|  2  5  and  n  s  (0,  .031.  Furthermore,  V  satisfies  the  Hamil- 
ton-Jacobi  equation  (13)  with  an  error  of  m2^2x2x2. 

If  we  are  only  interested  in  the  optimality  of  the  reduced  problem  and  consider 
the  z-part  as  due  to  “system  parasitics,"  we  can  apply  the  reduced  control  u0  to  (56)  as 
*  - 1  is  stable.  System  (36)  controlled  by  u0  is 

(66)  x-xr,  n2  -  -x2-r. 

Transforming  r  to  17  *  z  +  x2,  system  (66)  becomes 

(67)  jc  » -x3-t-xn,  -2nxl-(\-lixxl)v- 

We  use  U  in  (62)  as  a  Lyapunov  function  for  (67)  and  the  time  derivative  of  U  with 
respect  to  (67)  is 

U  -  -[’-|2(v2-  lXv'2  +  1  -JTx2)j]x*-*  -“2(v2*  1  -  *x  V] 

(68) 


NEAR  OPTIMAL  FEEDBACK  STABILIZATION 

Thus  for  ail  x,  enclosed  in  5  and  ?  » .06,  U  is  negative  definite  for  all  m  6  (0.  .02]. 
Hence  x«0,  z*0  of  (66)  is  asymptotically  stable  for  all  |xj S .3,  |z+x2|;S5. 

(0,  .02]. 

To  obtain  an  0(m:)  approximation  of  V  in  the  sense  of  Theorem  3,  we  solve  (S3) 
for  higher  order  terms  of  V\  and  obtain 

(69)  ii2«u«  ~m2x2z, 

x* 

(70)  Vl» 

System  (S6)  controlled  by  «2  becomes 

(71)  i-xz,  ni  ■ 
or,  in  the  x,  rj  »z  +  x2  variables, 

(72)  x»-x5+xtj,  77, 

which  is  globally  asymptotically  stable  for  all  m  >0-  Furthermore.  V2  satisfies  (15) 
with  an  error  of  ft  2(8x4z 2 + 2x 2  z J). 

7.  Conclusions.  A  nested  power  series  expansion  method  has  been  proposed  for 
solving  the  optimal  control  problem  of  a  class  of  nonlinear  singularly  perturbed 
systems.  The  terms  in  the  expansion  V  are  obtained  from  equations  involving  only  the 
slow  variable  x.  In  addition,  V%  and  V?  are  solved  for  independently.  Explicit 
consideration  of  the  initial  boundary  layer  is  avoided  and  it  is  optimized  by  the  z 
variable  feedback.  Sufficient  conditions  are  obtained  such  that  feedback  controls  using 
truncated  series  stabilize  the  nonlinear  systems  and  the  stability  domain  can  encom¬ 
pass  large  initial  conditions  of  z.  These  truncated  controls  can  achieve  near-optimality 
of  0(jx).  OO* 2).  etc.  In  particular,  an  0(ji)  near-optimal  feed-back  control  can  be 
implemented  without  knowing  the  value  of  the  small  parameter  ix.  The  results  apply 
to  essentially  nonlinear  problems. 

Appendix.  Substituting  (23)  into  (20)  and  rearranging  yields 

0  -  X,  +  VoJCj-i  V0MX- j  V’0l, 

where 

Xi-p-(s'  +  la'tV2)AVal-fa'  +  aiV1)AVB2R-iBiA'2-Hh  +  V2ai), 

Xi  -  <*2 +  SoR  " 1  B'2Ai 1  (i s  +  V2a2),  X}  -  8*R  " 1 1  S'0, 

avai-iAi-BtR-'B'iVMVa*,  $0-  Bt -(A,  -B:R~lB'2Vz)AilBz, 

AfAi-BiR^BiVt, 

and  the  superscript  0  in  Vo*  and  V\  has  been  dropped.  Let  H  **  I  +  R~l  B'zVzAz' Bz- 
Then  -  /  -_/?'*  B'2V2aV  Bz  and  H'~lRH~l  •  R  ^BzAz~'QAzlBz  »/?0.  Thus 

80  m  B\H  ~  A 1 A 2  *  Bz m  B0H.  Hence  Xj m  BqRo  Also, 

Xz-ao  +  BoR;'[(R+BzAz~'QAVBz)R~lBzVzAV+BzAz‘'Vz]az 

+  \BoRZ'BzA'z~'s 

-ao+BoRZlBzAz-'(AiVz  +  QAVBzR"BzVz+VzAz-VzBzR'lBzVz)A;' 

+■  iBoRo  'SiA-  's 
*an-  BnRu'sc,. 
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Furthermore,  Az 1  BzR~l  BzA'f1  m  Az'  B2HR~l  H'  B'zA 

Az 1  *  Az '  ■*“ Aj lBjB  ^Bi^jAi1 


—  i 


■  A;  '  BzRa x B'zA'z  1  and 


- A71+aVBzRo'B'z(V2+Az1QA71BzR~1BzVz)AV 
» AV-AzlBzRolBzAzlQAzl~Az'BzRolBzA'i-lVz ■ 

Thus  AT i  becomes 

Xt  * p  —  r  Az 1  flj ^ s  Az  'B2Ro  lB2A2  'QAj1- iiA2  BzRo  BzAz  s 

+a'zVzAVBiRo'BzA'r'Vzaz-a'z{VzAV+Ai~lV2)az. 


But 

V,aV  -hAf1  Vj-  -  Vz Az1  -  Aj"1  V2  +  V2A? BzRo1  B'zA'f[QAll 

+  AzlQAV8zR;'BzAV  v2 
+  2VzAVBzRZ1B2A'z"Vz 
- Az'OAl1  -A'z~'V2BzR~1BzV:AV 

+  (V2  +  A'flQ)AzX  B2Ro'  B2A'z~l(V2-r  QA2') 

+■  VjA  2  'BzRv '  B  ;A;  1  V;~Aj  QA2  B2Ro  BzA2  *QA2l, 
and 

A’z~l  V2BzR~lB'z  V2Az1  -  ( -( V2  ^  ArlC?:)Ar 1 

ta;;'  v2  b2r  ~1b2v2a2'  \b2r  ~  'a;  a; 


that  is, 

-  ( Vz + A  i* 1 '  O  )A  z 1  Bj  R ' 1 B  z  A  z"' 1  ( Q A j" 1  +  Vt ), 

implying  »po-JoBolio-  Hence  elimination  of  V',  from  (20)  yields  the  Hamilton- 
Jacobi  equation  (11)  of  the  reduced  problem. 
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ABSTRACT 

The  composite  control  proposed  in  an  earlier  paper 
for  a  class  of  singularly  perturbed  nonlinear 
systsas  is  now  shown  to  possess  properties  essential 
for  near-optimal  feedback  design.  It  asymptotically 
stabilizes  the  desired  equilibrium  and  produces  a 
finite  cost  which  tends  to  the  optiaal  cost  for  a 
slow  problem  as  the  singular  perturbation  paraaeter 
tends  to  zero.  Thus  the  well-posedness  of  the  full 
regulator  problea  is  established.  The  stability 
results  are  also  applicable  to  two-tiae  scale 
systems  which  are  not  singularly  perturbed,  and  the 
paper  does  not  assume  the  knowledge  of  singular 
perturbation  techniques. 

1.  INTRODUCTION 

* 

A  conceptually  appealing  framework  for 
simultaneous  stabilization  and  optimization  of 
feedback  systems  aonsists  in  requiring  that  the 
Bellman’s  optimsl  value  function  be  in  the  same  time 
a  Lyapunov  function.  This  has  been  elegantly 
achieved  in  Kalman's  linear  regulator  theory  as  a 
culmination  of  earlier  efforts  by  Lur’e,  Krasovski, 
Bellman,  and  many  others.  However,  in  dealing  with 
nonlinear  problems,  the  Lyapunov-Bellaan  concept  has 
serious  drawbacks.  One  of  them,  the  notorious 
"curse  of  dimensionality,"  is  frustrating  to 
practitioners.  Another  one,  the  question  of 
existence  and  differentiability  of  the  optiaal  value 
function,  disturbs  the  analytically  minded.  Similar 
difficulties  appear  on  the  Lyapunov  side  because  of 
the  lack  of  general  methods  for  constructing 
Lyapunov  functions.  Nevertheless,  the  optimum 
stabilization  continues  to  be  one  of  the  fertile 
concepts  stimulating  the  development  of  numerical 
and  analytical  methods  ror  nonlinear  regulator 
design  [ 4-7 ] .  Moat  analytical  methods  assume  that 

the  linear  part  of  the  system  is  dominant  and  design 
a  linear  regulator  as  a  first  approximation,  to  be 
subsequently  corrected  by  series  expansions  (5,7]. 
This  approach  is  applicable  to  many  nonlinear 
systems,  but  it  also  has  important  limitations. 
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First,  it  is  not  directly  applicable  if  the  linear 
part  la  not  dominant,  second,  calculation  of 
expansions  increases  the  dimensionality 
difficulties,  and,  third,  ill-conditioning  due  to 
fast  and  slow  phenomena  remains. 

The  two-time-scale  approach  presented  in  this 
paper  avoids  linearization  and  directly  addresses 
the  dimensionality  and  ill-conditioning 
difficulties.  Its  philosophy  can  simply  be  stated 
as  follows:  "Design  the  slow  subsystem  first,  by 
assuming  that  the  fast  subsystem  has  already  reached 
its  steady  state.  Then  design  the  fast  subsystem 
for  a  set  of  constant  values  of  the  states  of  the 
slow  subsystem.  Combine  the  two  designs  by 
guaranteeing  stability  and  naar-optimallty 
properties  of  the  resulting  system."  The  method 
proposed  in  [3]  and  developed  her*  implements  this 
design  philosophy  on  the  systems  nonlinear  in  slow 
variables  and  linear  in  rast  variables  and  control. 

The  class  of  systems  considered  is  assumed  to 
be  in  the  standard  singular  perturbation  form 
exhibiting  explicitly  a  parameter  u.  which  can  be 
interpreted  as  the  order  of  magnitude  of  the  ratio 
of  the  slow  and  fast  state  speeds.  Although  this 
form  simplifies  the  definition  of  the  subsystems, 
the  paper  does  not  require  any  familiarity  with 
singular  perturbation  techniques.  The  slow  and  fast 
subsystems  can  be  considered  as  postulates  whose 
validity  is  subsequently  demonstrated  by  the 

properties  of  the  actual  system  controlled  by  the 
proposed  composite  control.  Since  the  proofs  of 
these  properties  are  elementary  and  make  use  of  only 
Bellman's  principle  of  optimality  and  Lyapunov-type 
arguments,  the  paper  can  be  read  with  no  more  than  a 
basic  background  in  control  theory.  The  steps  of 
the  design  procedure  are  presented  on  a  simple 
example.  The  method  of  this  paper  is  radically 

different  from  the  finite  interval  trajectory 
optimization  results  of  [8,9]  because  of  the 
stability  and  boundedness  requirements  fundamental 
in  infinite  time  problems,  which  require  feedback 
solutions. 

2.  FULL  PROBLBt 

The  problea  considered  is  to  optimally  control 
the  nonlinear  system 

i  *  a,(x)  ♦  A,(x)x  *  B  (x)u,  x(0)  «  x  (2.1s) 

111  o 

US  *  SjCx)  ♦  A2<x)z  ♦  B2(x)u,  z(0)  a  ZQ  (2.1b) 

with  respect  to  the  cost  function 


m 

J  *  f[p(x)*s'  (x)s*t'Q(x)t*u'B(x)u]dt  (2.2) 

o 

where  uX>  is  ths  singular  perturbation  parameter,  «, 
*  srs  n-,  m-dimenslonal  ststss,  respectively,  u  is 
an  r-dimenslonal  control  and  ths  prims  denotes  a 
transpose.  Regulator  problems  for  systems  linear  in 
the  control  and  nonlinear  in  the  state  have  been 
considered  earlier  (6].  Here  the  system  is  also 
linear  in  the  fast  state  variable  a,  as  is  for 

example,  the  case  with  models  of  dc  motors  and 
synchronous  machines  (2].  He  amice  an  assumption 
which  in  addition  to  differentiability  and 
positivity  properties  of  terms  in  (2.1),  (2.2)  also 
guarantees  that  the  origin  is  the  desired 
equilibrium. 

Assumption  I:  There  exists  a  domain  0  Rn, 
contaTnftX  rtW»  origin  as  an  interior  point,  such 

that  for  all  xcD  functions  ai,  aj,  A^,  Aj, 

A51,  Bi>  Bo,  p,  a,  R,  and  Q  are  differenti¬ 
able  with  respect  to  x;  a^,  aj,  p,  and  s  are 
zero  only  at  x«0;  Q  and  R  are  positive  definite  ma¬ 
trices  for  all  xeD;  the  scalar  p«s'z4-z'0z  is  a 
positive  definite  function  of  its  arguments  x  and  z, 
that  is,  it  is  positive  except  for  xsO,  z=0  where  it 
is  zero. 

An  approach  to  the  full  problem  (2.1),  (2.2) 

would  be  to  assume  that  a  differentiable  optimal 
value  function  V(x,z,ii)  exists  satisfying  Bellman's 
principle  of  optimality 

0  *  mJnCp*s'z*z,Qz*u,Ru+Vx(a14-A1z«-B1u) 


*  U  VV*2**B2u)]  (2.3) 

where  Vx,  Vz  denote  the  partial  derivatives  of 
V.  Since  the  oontrol  minimizing  (2.3)  is 

u  *  -  \  R*1(B'V’  ♦  7  B1V)  (2.#) 

m  c.  l  x  u  c  z 

the  problem  would  consist  in  solving  the 
Hamilton-Jacobl  equation 

0  *  p*x'z*z'Qz->  ^Uj+A^)  ♦  V^Ca^-AjZ) 

-i(vxBi*iwR"i  (Biv;*iB2v;>' 

v(0,0,u)  S  0  (2.5) 

This  would  be  a  difficult  task  even  for  well  behaved 
nonlinear  systems.  Due  to  the  presence  of  ^  terms  in 

(2.5),  the  difficulties  with  singularly  perturbed 
systems  (2.1)  increase.  The  method  of  this  paper 
avoids  these  difficulties.  In  contrast  we  take 
advantage  of  the  fact  that  as  the  slow  and  the 
fast  phenomena  in  (2.1)  separate.  We  do  not  deal 
with  the  problem  (2.1),  (2.5)  directly.  Instead  we 
define  two  separate  lower  dimensional  subproblema, 
slow  and  fast.  The  assumption  about  existence  and 
differentiability  of  the  optimal  value  function  is 
then  made  only  for  the  slow  subproblem,  while  the 
assumption  for  the  fast  subproblem  is  similar  to 
those  made  for  linear  quadratic  problems.  The 
solutions  of  the  two  subproblems  are  combined  into  a 
composite  oontrol  whose  stabilizing  and  near  optimal 
properties  are  the  main  subject  of  the  paper. 


3.  SUM  3UBPR0BLB1 

Because  of  the  presence  of  u,  system  (2.1) 
exhibits  a  "boundary  layer,"  that  is,  a  fast 
transient  in  the  variable  s,  after  whose  decay  both 
x  and  z  vary  slowly  with  time.  Setting  1*  0  the 
fast  transient  is  negleoted,  that  is, 

*s  •  W  *  W*.  *  Wv  x.(0)  *  V3-u) 

0  »  a2(xs)  *  A2(*,)z#  ♦  B2(xt)u#,  (3.1b) 

and,  sinoe  A^  is  assumed  to  exist, 

W  *  "A2-1(*2  *  Vs5  (3-2) 

is  eliminated  from  (3.1a)  and  (2.2).  Then  the  slow 
subproblem  is  to  optimally  oontrol  the  slow  subsystem 


x  *  a  (x  )  ♦  B  (x  )u,  x  (0)  «  x„ 

9  0S  OS  3  O 


with  respect  to 


Js  *  i  cPo(x,)*2»;(x,)u,  *  u;vx,)u,]dt 


•o  •  *1 


.  .  -1 
*1*2  *2 


Bo  ‘  B1  “  *1*2  ®2 
Po  .  p  -  s'*2'1a2  * 

*0  *  B2*f1(Q*2~1*2  _  2  s) 

RQ  *  R  ♦  B^A^OAj'Sj.  (3.5) 

We  note  that  xs  *  0  is  the  desired  equilibrium  of 
the  slow  subsystem  (3-3)  for  all  x,eD,  since,  in 
view  of  Assumption  I,  ao(0)  >  0  and  the  integrand 
in  (3.4)  is  positive  definite  in  x,  and  u9,  that 
is 


P„(x  )  *  2s  (x  )u  *  u  R  (x  )u  >  0, 

09  093  3093 


xs  t  0,  us  t  0  (3.6) 

Our  crucial  Assumption  II  concerns  the  existence  of 
the  optimal  value  function  L(xs)  for  the  slow 
subproblem  satisfying  the  optimality  principle 


0  .  min[po(xs)  ♦  2S<;(xs)u9^Ro(xs)u9 

*  Lx(ao(xs)*Bo(xs)us)]  (3>7) 

where  Lg  denotes  the  derivative  of  L  with  respect 
to  its  argument  x9.  The  elimination  of  the 
minimizing  oontrol 

u.  *  -R'1(so  *iBoS;)  (3-8) 

from  (3.7)  results  in  the  Hamilton-Jacobl  equation 


-KirtMllits- 


0  *  (p-aR*1s)  +  L  (a  -B  *  -18  ) 

0  O  O  0  xooo  o 

.  r  L  B  1  ,  L(0)  *  0,  (3*9) 

H  X  O  0  OX 

where,  due  to  (3-6),  P0”»oRo"1#o  i#  P°*itiv* 


unique 

differentiable  poeitiva 

definite 

~(xs) 

with  the  property  that 

positive 

*1.  “2. 

,  kj,  ki)  exist  such  that 

k,L  L’ 

S  -L  a  i  k  L  L* 

1  X  X 

x  o  2  x  x 

S  Vo  5  k4*>V 

<3.10) 

(3.11) 


Assumption  II  allows  L(x,)  to  be  used  as  a 
Lyapunov  function  guaranteeing  the  aay aptotic 
stability  of  x,  *  0  for  the  slow  subsystem  (3*3) 
controlled  by  (3.8).  that  is  for  the  feedback  systea 


*  an  -  B  R  ”*(s  ♦  \  B'L' )  «  i  (x). 

O  00  O  ZOX  09 


(3.12) 


It  also  guarantees  that  D  belongs  to  the  region  of 
attraction  of  x3  *  0.  For  convenience  we  will 
take  a  level  surface  L(xs)  ■  e0  to  be  the 
boundary  of  D.  It  is  pointed  out  that  Assumption  II 
does  not  guarantee  the  exponential  stability.  This 
would  be  unnecessarily  restrictive  and  would  exclude 

soae  cooBon  slow  subsysteas  such  as  x  »  -x^. 

s  a 

Conditions  (3*10),  (3.11)  characterize  the  slow 
subproblea  solution  L  by  bounding  the  rate  L  *  L  a 

X  o 

at  which  it  decays  to  zero  along  the  trajectories  of 
(3*12).  These  bounds  enooapass  a  larger  olasa  of 
nonlinear  systeas  than  do  soae  acre  coaaon 

conditions  based  on  exponential  stability  of 
linearized  aodels  [5.7].  When  the  solution  L  of  the 
slow  subproblea  is  known,  conditions  (3.10),  (3.11) 
are  readily  verifiable.  This  is  how  they  are  used 

in  our  two  stage  design.  We  first  solve  the  slow 

subproblea  by  one  of  the  existing  methods,  taking 
advantage  of  the  fact  that  its  dimensionality  is 
lower  than  that  of  the  full  problea.  At  the  end  of 
this  stage  L  is  known  and  (3.10),  (3.11)  are 

checked.  If  they  are  satisfied,  we  proceed  to  the 
second  stage,  that  is  we  solve  the  fast  subproblea. 

4.  FAST  SUBPROBLOI 

To  aotlvate  the  formulation  or  the  fast 
subproblea  we  observe  that  x  being  predoalnantly 
slow  aeans  that  only  an  0(u)  error  is  aade  by 
replacing  x  with  xs,  or  vice  versa.  Thus,  when  we 
subtract  (3.1b)  from  (2.1b)  we  obtain  the  systea 


u(z-z  )  *  A,(x)  (z-z  )  *  B,(x)(u-u  )  -  uz  (4.1) 

which  can  be  further  siaplifed  by  neglecting  the 
r.h.s.  0(u)  term  -i dg.  Defining  xf*z-zs  and  u^»  u-ug 
the  system  (4.1)  beooaes 

l *  Aj(x)zf  ♦  Bj(x)uf,  zf(0)  *  zo-z#(0).  (4.2) 

Following  a  similar  reasoning  we  define 


Jf  *  I  (zfQ(x)zf  ♦  ufR(x)uf)dt. 


Mow  (4.2)  and  (4.3)  constitute  our  fast  subproblea 
for  eaoh  fixed  xtD.  it  has  the  familiar  linear 
quadratic  fora. 

Assuaotlon  III;  For  every  fixed  xcD 


rankCBg,  A^ . A;  B^]  *  a. 


Alternatively  a  less  deasndlng  stabllizabllity 
assuaptlon  can  be  made.  Recalling  also  that 
R(x)  >0,  Q(x)X>  (see  Assuaptlon  I),  we  obtain,  for 
eaoh  x<D,  the  optimal  solution  of  the  fast  subproblea 


uf(sf,x)  >  -R  (x)B£(x)K(x)zf  (4.5) 

where  K(x)  is  the  positive  definite  eolution  of  the 
x -dependent  Rlocatl  equation 


0  «  SA2  ♦  AjC  -  KBgR  B2K  ♦  Q.  (4.6) 

The  control  (4.5)  is  stabilizing  in  the  sense  that 
the  fast  feedbaok  systea 


Msf  »  (Ag-BjR'^Otj.  »  I2(x)zf 


has  the  property  that 

Rel[I2(x)]  <  0,  VxeD.  (4.7b) 

5.  THE  COMPOSITE  CONTROL 

Compared  to  the  full  problea  (2.1)  -  (2.5),  the 
subprobleas  are  easier  to  solve  due  to  the  ract  that 
the  fast  subproblea,  although  parameter  dependent, 
is  a  linear  regulator  problea  and  the  slow 
subproblea,  although  nonlinear,  is  of  a  lower  order 
than  the  full  problem.  However,  the  controls  us 
and  Uf  are  applicable  to  the  elow  and  the  fast 
subsysteas,  respectively,  which  do  not  exist  in 
reality.  Our  goal  is  to  use  u,  and  uf  to 
control  the  actual  full  system  (2.1).  To  accomplish 
this  we  now  fora  a  'composite'  control  ^  * 

u,*uf,  in  which  x9  is  replaced  by  x,  and  Zf 

by  z*A2  (a2*B2ug(x)).  Thus  the  composite  control  is 
-1  -1 

ue(x,z)  i  u#(x)  -  R  B^K(z*A2  (a2-B2ug(x))) 


•  -R”l(s  *  4  B'L’ )  -  R'1BlK(z  ♦  l  a,)  (5.1) 

O  O  Z  O  X  Z  Z 


a2(x)  •  a2  -  ±  B2R  (B^LN.  BJV^, 


»  -(s'  ♦  a^K  *  (•xa1)*2 


*1  *  *1  *  B1R  ®2K’  (5.2) 

Note  that  u0  is  independent  of  u,  which  simplifies 
the  design  procedure  when  u  is  a  snail  but  unknown 

parameter. 


--'muHMiMMtfK9 


(6.7) 


For  u,  to  M  i  meaningful  feedbaok  oontrol  of 
tM  system  (2.1),  It  aust  first  of  all  be  a 
stabilising  control.  Furthermore  f or  ue  to  be  a 
candidate  for  the  optimisation  of  (2.2),  tba  full 
system  (2.1)  eoatrollad  by  Ug  auat  raault  In  a 
bounded  eoat  (2.2).  Aa  u*0,  tba  full  ooat  ahould 
approach  tba  ooat  of  tba  alow  aubprobloa.  This 
would  Imply  that  ue  la  a  naar-optinal  oontrol  and 
tbat  tba  regulator  p  robin  la  well«posed.  Tba 
bound ednaaa  and  naar-optlaality  raaulta  in  tba 
aubaaquant  aaotlona  are  new,  while  tba  atabllity 
raault  la  aaaantlally  the  aa me  aa  [3],  but  In  a  now 
alaplar  form. 

6.  STABILITY 

The  full  ayataa  (2.1)  controlled  by  the 
coapoalte  oontrol  (3.1)  ia 

x  •  a,  *  A,z  ♦  B,u  *  a,  (x)  ♦  X,  (x)x,  x(0)  •  x 

1  1  1  o  1  1  o 

ut  *  a,  ♦  Aji-tBjU^  *  a^tx)  ♦  AgCx)*,  a(0)  *  zq 

(6.1) 

where 

ax  *  ax  -  i  B^R  \b'Lx  ♦  b'v^,  ax(0)  «  0,  (6.2) 

and  baa  the  following  atabllity  property. 

Thooroa  6.1;  If  Aaauaptlons  I  -  III  are  aatlafiad, 
there  exlsta  a  u*>0  such  that  the  equilibrium  x  *  0, 
1*0  of  ayataa  (6.1)  ia  asymptotically  atabla  for 
all  uc(0,|i*]. 

-Proof:  Introducing 

-1  -1 

*f  *  x  ♦  Ij  a2,  if (0)  *  *,-**2  <*o)*2<*o)  *  *fo 

-*1. 

and  F(x)  *  (A2  a2>x  ,  we  rewrite  (6.1)  aa 
i  *  ao  ♦  l^if,  (6.4a) 

vi.  *  iP(x)a  *  (A  *  uF(x)I )z,.  (6. Kb) 

r  o  c  lx 

Observing  that  (6.4a)  baa  the  form  of  the  alow 
aubayatea  (3.12)  with  the  additional  forcing  tern 

IjZf  and  that  (6.4b)  is  an  0(u)  perturbation  of  the 

fast  aubayatea  (4.2)  controlled  by  the  fast  control 
uf  (A. 5),  that  is  of  (4.7a),  we  use  the  aua  of  the 
alow  and  the  fast  Lyapunov  functions 

v(x,if,u)  *  L(x)  *  (QBfKCx )Zf  (615) 

as  a  tentative  Lyapunov  function  for  (6.4)  where  a 
is  a  positive  scalar  to  ba  chosen.  Since  L(x)>0  and 
K(x ) >0  in  D,  v  is  positive  definite  for  all  xd), 
zfCR"  and  u>0*  The  proof  consists  in 

showing  that  the  tlaa  derivative  v  of  v  with 
respect  to  (6.4)  ia  negative  definite.  After 

completing  the  squares  v  can  be  put  in  the  fora 
v  *  -g(x,u)  a(  Q(x)5-omfM(x,Zf,u)tf  (6.6) 


y  *  I’L-  ♦  2atdCFs 

XX  o 

C  *  if  -  Q"Xy/a 

H  *  Q/2  *  KBjR'^IC  -  M(KFi1*X*fK)  -  IK 

Using  the  fact  that  x^epeadent  quantities  in  g 
are  bounded  for  xcD,  that  la, 

<  ky  Ul1Q"1KFII  S.  tc6,  *ir,KQ"1KFii  <  k?, 

(6.8) 

and  recalling  that  k^L;  S  -L^,  kjJ-^  i  -L^. 

sea  (3>10),  (3.11),  wa  obtain 

yQ"Xy  i  (k5  ♦  3out6)LxL'  ♦  (3auc6  ♦  c?^)^ 

S  -ail  (6.9) 

x  p 

vNrt 

(Xflb)  *  kj^fkg  ♦  3aut6)  ♦  k3“l(3«it6  +  o2u2k7). 

(6.10) 

It  follows  froa  (6.9)  that 

g  >  -Lxa0(l-o/2o)  (6.11) 

and  hence,  to  aake  g  positive  definite,  it  is 
sufficient  to  ohoosa  axj/2.  A  convenient  choice  1  s 
to  take  a  to  be  the  value  of  o  when  aiml.  Since  a 
is  a  aonotonlcally  increasing  funotion  of  ap20,  this 
choice  laplles  that 

**"2Lx*o>0  Vmc  (0,  X).  (6. 

To  oomplete  the  proof  we  need  to  show  that  N  is  also 
positive  definite.  Noting  that  the  first  two  terms 
of  M  are  positive  definite  we  now  establish  tl>*t 
they  dominate  the  last  two  terns,  which  are  sm» ,  1 
for  u  sufficiently  small.  Using  the  bounds  (6.6) 
and 

IK II  *  IK  xli  i  IK  II  If  ♦  X.z.H  (6.13) 

x  x  o  1  f 

we  conclude  that  there  exist  positive  constants 
and  kg  such  that 

M  2  £  (0  ♦  KBjR^BJK)  (6.)  ' 

holds  for  all  xd),  all  Zf  such  that  UtfH  £<g, 
and  all  uc(0,Ui].  Thus  for  all 

UC  ((Mi*),  u*  *  min  (^,  1^)  (6.15) 

the  derivative  v  of  v  in  (6.5)  for  system  (6.1), 
or,  equivalently,  for  system  (6.4),  is  negative 
definite  and  henoe  the  equilibrium  x*0,  z*0,  is 

asymptotically  stable. 

Froa  this  proof  we  san  readily  obtain  an 
estimate  of  the  region  of  attraction  of  x*0,  z*0.  A 
well  known  estimate  is  the  set  of  points  x,  z 
encompassed  by  the  largest  closed  surface 

v(x,z,u)*e  for  whioh  via  negative  definite. 

0 


wh«r« 


To  eaoh  fixed  uc(0,i*]  there  oorreapooda  ooe  auoh 
sot  denoted  by  Su.  All  Su  aata  ooa  tain  all  x®, 
but  differ  la  tba  aasnitudaa  of  s,  baoauaa,  as  It 
oaa  ba  inferred  from  tba  a  bora  proof,  tba  larger  u 
la,  tba  smaller  Sf  la  allowed.  Thu*  tba  aat 
corresponding  to  tba  largest  value  of  u,  that  la 
to  u*.  la  tba  largaat  aat  and  la  danotad  by  3*. 
Slnca  tbla  sat  la  tba  lntarsaotlon  of  all  Sy  aata, 
It  oaa  serve  aa  a  oo— an  aatlaata  for  tba  regions  of 
attraction  for  all  values  of  u40,i£].  A  proof  of 
tbla  faot  oonalata  of  tba  oaloulatloaa  analogous  to 
thosa  loading  to  (6.6)  through  (6.15),  but  tbla  tins 
for  v  with  u  flxad  at  that  la  for  v(x,x,t*), 

ratbar  than  for  v(x,z,u).  Omitting  tbaaa 
oalculatlona  wa  atata  tba  result  in  tba  fora  useful 
for  our  subsequent  analysis. 

Corollary  6.2:  Under  the  assumptions  of  Theorea  6.1 
there  axlat  positive  oonstants  U*  and  eg  auoh  that 
tba  aat 


(6.16) 


S*(x,z)  «  (x,x:  v(x,x,|i*)  <  o  } 

o 

belongs  to  tba  region  of  attraction  of  xsO,  xsO  for 
all  uc(0,M*],  that  la  all  trajectories  of  (6.1) 
originating  In  S*  at  taO  remain  In  3*  for  all  t>0 
and  converge  to  x*0,  x*0,  as  t-"*. 


(t  ,•)  by  Je  and  Integrating  (7.3)  froa  tg 
to  •  wa  obtain 

Jg  *  [q(0,0)-q(Xg,Sg)]  1  0  (7.4) 

Mblob  in  view  of  q(0,0)s0  and  the  foot  that  q(xg, 
xg)  la  finite,  proves  that  Jg  la  bounded. 

To  apply  this  laaaa  wa  substitute  (5.1)  and 
(6.3)  for  ue  and  x,  respectively  into 


J  a  J  (p*e'z*z'Qt*u'Ru  )dt  »  J  f (x,z)dt 
C  ,  CO  .  c 

o  o 


(7.5) 


and  rewrite  tba  integrand  aa 

fc(x,x>  •  -Lxa0  -  a'xf  ♦  z£(Q  *  KB^BJIC)  xf 


*  f(x,zf) 


(7.6) 


where 


ar  «  a  ♦  KB2R-1(B^  ♦  B^) 


7.  BOUNDEDNESS  OF  J 

Asymptotic  stability  of  an  equilibrium  at  the 
origin  la  not  aufficiant  to  guarantee  that  an 
integral  of  the  type  (2.2)  will  ba  finite  along  tba 
trajectories  asymptotically  converging  to  this 
equilibrium.  For  example,  when  tba  control 

2  5  *2 

ua-x  -x  is  applied  to  the  system  x  «  x  -*u,  then  the 

•  5 

equilibrium  xaO  of  x  a  -x  la  asymptotically  atable. 

However  the  solutions  for  x(0)  a  x  a  0  are 

o 

x(t)  .  slgn(xo)  (At  ♦  (xo)'i‘)  *l/\  (7.1) 

and  hence  the  cost 

J  a  J  (x"  ♦  1/2  u2)dt  (7.2) 

o 

is  infinite.  Thus  It  is  not  sufficient  that  our 
composite  control  be  only  a  stabilising  control.  To 
qualify  as  a  candidate  for  near-optimality  Uq  must 
also  produce  a  bounded  J.  To  show  that  this  is  the 
case  we  use  the  following  lemma  from  [1],  which  is 
implicit  in  [4.6]. 

Lemma  7.1:  Suppose  that  system  (2.1)  controlled  by 
u(x,z)  has  xaO,  zaO  as  its  asymptotically  stable 
equilibrium  for  all  x0,z0eS.  Let  this  fact  be 
established  by  a  positive  definite  Lyapunov  function 

• 

q(x,z),  whose  derivative  q(x,z)  is  negative  definite 
in  S.  If  there  exists  a  ball  8  centered  at  xzO,  zzO 
such  that  for  all  x,zc6, 

p  ♦  j'z  ♦  x'O*  ♦  u'fci  ♦  4  10,  (7.3) 

then  the  cost  (2.2)  is  finite  along  all  the 
trajectories  which  originate  in  S  and  la  bounded 
from  above  by  q. 

Proof:  Let  tg  be  the  instant  when  a  trajectory  T 
originating  from  x0,z0cS  enters  the  ball  8 
through  xg,  xg  for  the  last  time  and  stays  in  8 
thereafter.  Tne  part  of  the  aost  along  T  over  the 
finite  Interval  CO.tg]  is  obviously  finite. 
Denoting  the  remaining  part  of  the  cost  over 


♦  2(Q  ♦  KBjR'^Bj  K)  Ij  a2.  (7.7) 

It  is  important  to  note  that  the  dependence  on  zf 
in  (7.6)  is  indicated  explicitly,  that  is,  the  term 

Lxao  is  independent  of  z^.  Furthermore,  f(x,  -zf)>0 
because  f(x,zf)  >  0  for  all  xCD  and  zfc x/0,  zf/0. 

Theorem  7.2:  Under  Assumptions  I  -  Til,  the 

composite  eontrol  Ug  produoes  a  cost  Jc  which  is 
bounded  from  above  by  4v  for  all  yc(o,u*]. 

Proof:  From  (6.12)  and  (6.15)  we  obtain 

f(x,zf)  ♦  4U  <  -f(x,  -zf)  «  0.  (7.8) 

From  Theorea  6.1  we  know  that  4v  is  a  Lyapunov 
function  for  system  (6.4)  and  we  use  it  as  q  in 
Lemma  7.1,  which  in  view  of  (7.4)  completes  the 
proof. 

8.  NEAR  OPTIMALITY 

The  question  can  now  be  posed  whether  uc, 
being  a  stabilizing  control  which  produces  a  bounded 
oost,  la  also  near  optimal  in  the  sense  that  as  vr*0 
the  cost  J0  tends  to  the  optimal  cost  for  yaO, 
that  is  the  optimal  oost  L(x)  of  the  reduced 
problem.  This  question  is  answered  by  expressing 
J0  as 

Jc(x,x,u)  a  L(x)  ♦  yV’(x)x  *  uz'K(x)z  *  uJ„(x,z,u) 

(8.1) 

where  the  first  two  u-terms  are  suggested  by  the 
linear-quadratic  fora  of  the  fast  subproblam.  If  we 
prove  that  J4  remains  bounded  as  ir*0,  this  will 
guarantee  that  Je(x,z,u)-*L(x). 

Theorem  8.1:  Under  Assumptions  I  -  III,  the 
composite  control  produces  cost  (8.1)  in  which  J4 
remains  bounded  as  u*0. 

Proof:  Cost  Je(x,x,u)  of  system  (2.1)  controlled 

by  Ug  satisfies  partial  differential  equation 


p  ♦  s's  *z'Oi  ♦  u'flu  ♦  (J  )  (•,  *  k. z  *  B,u  ) 

00  0X11  10 

*  (J  )  (a,  ♦  ♦  B  u  )/v  •  0,  (8.2) 

0  X  2  2  2  0 


(9.10) 


\ir  •  -zf 


J  (0,0,|i)  «  0. 

0 

Ho  have  shown  In  [3]  that  tbo  aubatltutlon  of  (8.1) 
into  (8.2)  and  tbo  uao  of  (3>9)i  (*.6),  and  (5.2), 
roduoo  (8.2)  to 

J4x(*l  J4*(*2  *  I2*)  * 

-(VJ*  ♦  a'Ks)x(a1  ♦  IjZ),  ^(O.O.u)  «  0.  (8.3) 

This  axproaalon,  and  tbo  faot  following  froa  Thaoroa 
7.1  that  11J4  la  bounded,  aro  uaad  in  tba  Appendix 
to  ooaplata  tbo  proof. 

In  addition  to  the  near  optlaality  of  tba 
ooapoaite  oontrol,  Thaoroa  8.1  alao  ahowa  that  the 
full  regulator  problea  la  wall  poaed  in  the  aanaa 
that  the  aaae  ooat  result*  froa  neglecting  u  in  the 
syataa  aodel  and  than  applying  tbo  oontrol  u.  to 
(3*3).  or  first  applying  tba  oontrol  uc  to  (2.1) 
and  then  neglecting  u- 

9.  TWO  STAGE  DESIGN 


Jf  «  /  (|z£*$-u2)dt  (9.11) 

o 

is  in  this  oasa  independent  of  x  and  its  solution  la 

K  *  9'  Uf  e  -tf  ,  gif  e  -2*f.  (9.12) 

Step  4:  Tba  design  ia  ooapleted  by  foralng  the 
ooapoaite  oontrol 

u  »  -x3  -  z  (9.13) 

0 

and  applying  it  to  tba  full  aystaa  (9.1).  The  final 
feedbaek  syataa  (6.1)  ia 

x  «  -  £  x3  ♦  z  (9.1b) 

t*  «  -x3  -  2z.  (9.15) 

It  should  be  noted  that  this  aystaa  could  not  have 
been  designed  by  aatbods  baaed  on  linearization, 
since  its  linearized  aodel  at  x*0,  x*0  baa  a  zero 
eigenvalue.  However,  Theorea  6.1  guarantees  that 
the  equlllbrlua  xsO,  nO  la  asyaptotically  stable 
for  u  sufficiently  aaall. 


The  steps  of  the  proposed  two  stage  design  will 
be  presented  on  a  siaple  exaaple  of  the  systaa 


♦  z 


(9.1a) 


Step  5:  With  the  help  of  Theorea  6.1  and  Corollary 
6.2  we  can  further  analyze  stability  properties  of 
the  designed  systea  (9.14),  (9.15)  which  is  first 

transformed  by  zf  *  x  ♦  1  x3  into  (6.4),  that  is  into 


ut  *  -a  ♦  u 

and  the  oost  functional 


s  J  (x6  *  4  z2  ♦  4  u2)  dt. 


Step  1;  The  slow  subproblea 

x  *  -  x3  ♦  u 
s  4  s  s 

J  *  J  (xf  ♦  uf)  dt 

*  o  *  * 

consists  in  solving  the  Hanilton-Jacobl  equation 


(9.1b) 

(9.2) 

(9.35 

(9.4) 


*  «  -  f  x3  ♦  *f 


ldr  .  -U±$x5  -  (2  -  ujx*)zr 
The  Lyapunov  function  (6.5)  is 

W  s  1  x*  ♦  <*i  \  zf 

and  to  analyze  its  derivative  (6.6) 
bounds  (6.8), 


(9.3 1 

(9.17) 

(9.18) 
evaluate  the 


*5 


*  >11  1.2 
*6  *  3  4  2  *  ' 


dL 

dx. 


■■I 


L(0) 


K3. 


.  -  I  X3. 

*  X 


which  yields 

1.1/,  u 

^  l’  fl 

3t#p  2;  Testing  the  conditions  (3-10),  (3*11) 

k  x6  <  5  X6  S  kj.6 
*l*s  5  4  a  s  *2* a’ 


S  “rf  1  i  *i  1  S  lt4xa’ 

we  see  that  they  are  satisfied  by 

kl  *  k2  *  i'  k3  *  S  *  5* 

Step  3:  The  faat  subproblea 


(9.5) 

(9.6) 

(9.7) 

(9.8) 

(9.9) 


They  are  to  be  used  to  find  an  a  guaranteeing  that  g 
in  (6.7)  is  positive  definite  for  all  xd>.  In  this 
exaaple  the  ehoice  of  D  is  free,  since  the  slow 
subsystea  is  asyaptotloally  stable  in  the  large. 

Suppose  that  we  are  interested  in  x«t-l,l] 

Then  kfi  E  g,  *7  >  ^  and  a  is  obtained  from  (6.10) 

as  cao(l),  that  is 

rlJ*  I*  ♦  4  54*  '  Ho-  (9*20) 

With  this  a  it  can  be  easily  verified  that 

•  *  4  (1  "  lla  (1  ”  if  aw‘2)2>  *  0  (9.2! ) 


-i 

~fl  *  (*f32x  *  Lx*i*2  p  ♦  afJ3F)  («0  *  Vf} 

*  ‘f(VSo  *  Vf,,8f  <46> 

is  bounded  fron  above  by 

-t(l  ♦  e^/kj  ♦  (Cj-vOj) ACjIL^Jq  ♦  (2*o)|)*Jxf  (A7) 

and  froa  below  by 

-t(l  ♦  »3)/k2  ♦  (Ojae^/k^]!.^  ♦  (2+e 4)*JJ6f  (A8) 


°1  -  '"iV  *  \  *  *iI2  * 


°2  *  "W  *  H2  *  (,lx  ♦  *r)Jo 


-A 

Cj  i  IW3H3"  .  Hj  *  I|l2 

c,  2  UK  ♦  |  (¥lx  ♦  2XF)\^  *  i  X*(S'x  ♦  2f'IC)ll. 

froa  (6.13)  »*•  know  that  K,  and  hanoa  o^,  raaaln 
boundad  as  u-0.  Furthermore,  ra writing  f(x,*f)  >  0 
la  (7.6)  as 


*l*f  *  *  L*\>  *  *f(Q  -  ra2*  >2K>*f.  (UO) 

and  using  tha  faot  that  tha  right  hand  sida  quantity 
is  posltiva  daflnita  for  all  xd>,  wo 

-1 

obtain  by  substituting  ±  I2  (J^  ♦  I1*f)  for  *f, 

-1 

lhix2  «0  *  Il,f)"  *  _<1  *  2o5/'c3)t"x*o  *  2«6*}»f(*ll) 
whara 

-1  .  -1 
e5  t  IMM  ,  ll(I2  )*(Q*KB2A'aBJK)X2  II 

°6  £  l4i»V-  (*12) 

Coabining  (A6)  and  (All)  ua  ooncluda  that  thara 

axlsts  y>0  such  that  f  is  boundad  by  lyvi,  which,  by 
leans  7.1,  provaa  that* 


J„  «  /  f^dt 


is  boundad. 
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I.  Introduction 


that  is, 


Until  recently,  angular  perturbation  techniques  [1]  have  primarily 
focused  on  stale  feedback  design  of  linear  regulators  (2J-{J]  and,  to  a 
smaller  extant,  on  open-loop  tngectoriaa  of  a  date  of  nonlinear  systems 
(61(7).  Advantages  of  these  techniques,  such  u  order  reduction  and 
separation  of  time  scales,  are  expected  to  have  a  more  dramatic  effect  on 
feedback  design  of  nonlinear  systems.  First  highly  encouraging  results  in 
this  direction  [tl,[9],(13]  are  related  to  feedback  design  of  stshilixing  and 
near-optimal  controls  for  nonlinear  systems  of  the  type 

xm/(x)+F(x)z  +  B,(x)u,  x(0)-x,  (la) 

Himf(x)+G(x)i+B1(x)m,  i(0)«ro  (lb) 

where  •  md/ dr,  xJSR",  t,|6U",  F,  G,  Bx,  Bj  ere  matrices  of 
approptiais  dimensions,  and  a  is  the  small  singular  perturbation  parame¬ 
ter.  A  particularly  promising  novelty  of  the  results  of  [11(9]  is  that  they 
apply  to  essentially  nonlinear  cases  of  (1);  that  is,  when  the  linearized 
system  yields  no  stability  information. 

In  this  short  paper,  we  clarify  the  results  of  (>],[9].  These  results 
represent  nonlinear  generalization  of  the  results  in  ($].  Since  the  details 
of  most  of  the  proofs  are  either  in  (>1(9]  or  are  similar  to  those  in  [31 
they  are  omitted  here.  Instead,  die  stress  is  on  the  meaning  and  applica¬ 
bility  of  the  theorems.  Although  the  analytical  results  here  build  upon 
those  of  (>1(91  for  application  purposes  this  short  paper  can  be  read 
without  referring  to  (>1(91  However,  an  understanding  of  [3]  is  helpful. 

The  outline  of  this  short  paper  is  as  follows.  We  begin  by  a  procedure 
for  separation  of  slow  and  fast  subsystems  of  (1).  Then  we  justify  both 
the  modeling  in  the  form  of  (1)  and  the  proposed  two-time-scale  proce¬ 
dure  by  two  nontrivial  but  common  examples  from  power  system  pract¬ 
ice:  a  third-order  dc  motor  model  and  a  fifth-order  synchronous  genera¬ 
tor  model.  This  justification  is  both  inspiring  and  necessary,  since  the 
two-time  scale  properties  are  dictated  by  physical  laws  and  daduced 
from  experience,  rather  than  inserted  into  models  for  analytical  or 
numerical  convenience.  The  analytical  results  are  then  presented  in  three 
pens  dealing  wi(h  stability,  stabilizability,  and  near-optimal  feedback 
control  The  short  paper  ends  with  an  example  demonstrating  bow 
simply  a  near-optimal  nonlinear  feedback-control  law  can  be  designed 
for  a  field-controlled  dc  motor. 

II.  Slow  and  Fast  Subsystems 

We  first  formulate  a  procedure  to  decompose  (1)  into  two  lower  order 
subsystems.  Because  of  the  presence  of  p,  system  (I)  exhibits  a 
boundary-layer  phenomenon  in  the  fast  variable  r.  If  the  boundary  layer 
decays,  then  the  dynamics  of  x  and  z  will  vary  slowly.  Formally  letting 
P>*0,  that  is,  neglecting  the  boundary  layer,  (1)  becomes 

i-/(x)  +  F(x)f +*,(*)«,  x(0)-x0  (2a) 

0«g(x)  +  G(i)r  +  *a(x)«  (2b) 

where  the  bar  above  the  variable  denotes  its  slow  part  Assuming  G(x) 
to  be  nonsingular,  we  obtain  from  (2b) 

z--G-'(t+B1i)  (3) 


y-G  (*)*■►*,(*)*  (6b) 

where  r'-t/p  it  tht  fan  time  scale. 

Under  the  conditions  specified  later,  the  response  of  system  (1)  can  be 
approximated  by 

*(r)-x(r)+0(p)  (7a) 

z(f)-*(»)+^(f)+0(p).  (7b) 

Thus  the  properties  of  system  (I)  can  be  investigated  by  examining  the 
subsystems  (4),  (6). 

III.  Applications  to  Elbctwcal  Machine  Models 

That  systems  of  tht  type  (1)  are  common  in  application  will  now  be 
shown  by  two  well-known  models  of  electrical  machines.  In  these  mod¬ 
els,  of  some  time  constants  serves  at  a  starting  for  tht  decom¬ 

position  of  the  original  systems  into  slow  and  fast  subsystems. 

In  electric-drive  systems,  higher  speeds  u  are  usually  achieved  by  the 
so-called  field  weakening.  In  such  a  regime  the  dc  motor  is  controlled  by 
its  field  voltage  V;,  while  its  armature  voltage  V,  is  constant  The  field, 
the  armature,  and  the  torque  equations  of  the  dc  motor  are 


dif 

LfS  “  ~  Vf 

(8a) 

di. 

(8b) 

■/^jfm~c**+c>ifit 

(8c) 

where  if.  Iff,  Lf,  im  Jt^  L,  are  the  currents,  resistance*,  and  inductance- 
of  the  field  circuit  and  the  armature,  respectively,  J  is  the  rotor  inert 
and  c„  Cj,  and  c,  are  the  back  cmf,  the  viscous  damping,  and  the  torque 
constants,  respectively.  The  field,  armature,  and  mechanical  time  con¬ 
stants  utT,-L,/R,,  T.-L./F..  and  r„-//(c,+c,c^/ KJ,  respec¬ 
tively,  where  if  is  the  nominal  value  of  i,.  Since  in  practice  Tf>T„  Tm, 
we  identify  if  as  the  slow  variable  and  im,u  as  the  fast  variables,  and  set  p 
ss  the  ratio  of  a  small  and  a  large  time  constant;  that  is.  p«  T,/7}« 

wv*.- 

Redefining  x- 1)-  if,  zy  —  i,-il,  tj-w-u*.  u«  Vf-  Vf.  where  if,  if, 
«•,  VJ  are  the  denied  equilibrium  of  system  (>),  we  obtain  system  (>)  in 
the  form  of  (1)  with 


'-HI  Mi' 


-  C|«*X 

X- 

T,R. 

T,  TfR. 

«,<;x 

<*t  (*  +  '/)  -«i 

where  a*  T./Tf/.  Then  the  slow  and  fast  subsystems  of  (9)  are 


and  its  elimination  from  (2a)  yields  the  slow  subsystem  or  the  reduced 
system  of  (1)  u 

i~(f-FG-'t)*(Bl-FG-lB2)u,  x(0)-x, 

-a(x)  +  B(x)C.  (4) 

To  derive  the  fast  subsystem  or  the  boundary-layer  system,  we  assume 
that  the  slow  variables  are  constant  in  tht  boundary  layer;  that  is,  0 
and  x-i- constant.  Subtracting  (2b)  from  (lb)  at  f-0,  we  obtain 

p(i-/)-C(xXx-/)+#,(xX*-6)-  (5) 

Redefining  Zf—i-i  and  ly-u-u,  we  formulate  the  fast  subsystem  of 
(I)  ** 

p*-<?(*V, ♦#,(*)«*,  Zf(0)~z0-z-(0)  (6a) 


tm~TfS*i;s  (l0) 

•  If  I  CiV+x)  ][ 

»  r,/  -  “  r,  pr  *v  do 

*v  “»(</♦*)  -<*a  j[*y 

respectively. 

As  a  second  example,  we  consider  a  well-known  fifth-order  model  of  a 
synchronous  machine  [10].  Neglecting  the  damper  windings  and  satura¬ 
tion,  the  equation!  for  the  direct  and  quadrature  axis  voltages  and  of, 
and  the  field-flux  linkage  are 

c,  ,  (L.Lf-Mi)  dt,  W 

- — - _  +  (12) 
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rt  '«  r,  dr  rtL,  1  rmL, 

03) 

-m-i+  — 

\  \ 

(23a) 

b*b  ,  uj.ht 

(14) 

of  .  (L,L<-M})5td 

“  *  r.L,  *  rmLf  ' 

(23b) 

where  i+  L+  rf,  L,  are  the  currents  and  reactances  of  the  d  and  q  axes, 
respectively,  r,  is  the  armature  resistance,  ty,  L,,  r.  are  the  field  voltage. 

The  fut  subsystem  is 

reactance,  and  resistance,  respectively,  is  the  mutual 

reactance 

7S  ■  ”14+  1 

between  the  i  axis  and  field  circuit,  Q  is  the  instantaneous 

per  unit 

(24a) 

angular  velocity  of  the  rotor,  and  r  is  the  per  unit  time.  The  swing 

dr’  4  rt 

equation  is 

*r  i. 

(24b) 

Jf-o-n,  T-«-V 

05) 

**  aF*b  a2 

w£.r,-0gi 

(16) 

where  f'-r'/p  and  the  tilde  denotes  the  fast  variables.  It  is  crucial  that 
in  (24)  the  slow  part  S  is  regarded  as  a  constant 

dr  Lf 

The  slow  subsystem  (22)  is  analogous  to  Kim  bark’s  third-order  model 

whan  $  it  the  rotor  angle,  (2,  the  nominal  vahia  of  Q,  u,  the  rated 
frequency  in  ndiaas/seconds,  H  the  inertia  constant,  and  the  input 
torque.  Note  that  the  torque  (2*  -  L,-  M^/Lf)i^  due  to  saliency  ha* 
been  neglected  in  (Id):  The  reason  for  thia  would  be  more  apparent  in  a 
modal  including  the  field  circuit  on  the  quadratic  axit  of  the  rotor. 

From  experience  it  ia  known  that  the  mechanical  and  field  circuit 
transients  primarily  described  by  (14),  (Id)  are  much  slower  than  the 
transients  in  the  d  and  q  axes  (12),  (13).  To  exhibit  thia  two- time-scale 
behavior  we  introduce  a  slow  time  variable 


rr  t 
'^"15 


(17) 


normalized  with  respect  to  the  d-axis  open-circuit  time  conatant  T'*, 
Defining  the  singular  perturbation  perameter  p  as  the  ratio  of  a  small 

and  a  large  time  constant 

P  '.V 

we  rewrite  (12).  (13)  in  the  slow  time  scale  as 


±  .  W 

dr'  r. 


where 


- - if-a2(i-Z7-' 


Wat 


(Lfh- MpQl,  M4 Ofr 


(LjLf-Mj,) 


(18) 

(19) 

(20) 

(2D 


(22a) 

dS  b  ( -  m4Wi\ 

dr'  2 “  b  j 

(22b) 

dif  .  LfO, 

(22c) 

[1 1 J.  Instead  of  neglecting  di4/dr,  difJdr  as  it  was  in  (1 11  we  set  p«0  to 
obtain  the  slow  subsystem.  We  also  obtain  the  fast  subsystem  (24) 
governing  the  transient  behavior  of  i4  and  ir  Since  this  order  reduction  is 
caused  by  a  parameter  perturbation  from  p> 0  to  p-0,  we  are  able  to 
use  approximations  of  the  type  y»y,  QmO,  and 

*«*4  +  V 

IV.  Stability  Proferties 

In  this  section  we  establish  some  stability  properties  of  the  full  system 
x-/(x)+F(x)r  (23a) 

pi-g(x)+G(x)r  (25b) 

from  an  analysis  of  the  lower  order  slow  and  fast  subsystems,  which  ate 

i-a(i)  (2de) 

liif-G(x)z,  (2Sb) 

respectively.  System  (25)  can  be  considered  as  the  feedback-controlled 
system  of  (1).  It  is  assumed  that  systems  (25),  (2d)  satisfy  the  following 
conditions  for  all  x,xBD,  where  D  is  a  closed  set  in  ft*. 

1)  The  vectors  f,g  and  matrices  F,G  are  bounded  and  differentiable 
with  respect  to  x,  and  there  exists  a  unique  x‘BD  such  that /(x*)-0 
and  g(x*)«  0. 

2)  The  eigenvalues  of  G  satisfy  Rc{A(</)}  <  a,  for  a  fixed  e,  <0.  Thus 
G  is  nonsingular. 

3)  There  exists  a  Lyapunov  function  p,(x)  for  (2da)  of  the 
Krasovskii’s  type  [10],  [1 1,  p.  38]:  that  is, 

c,(x)-«'(x)P(x)<i(x)  (27a) 

c,(x)-«'(x)N(x)<i(x)  (27b) 

where  the  matrix  P(x)> 0  is  differentiable  with  respect  to  x. 


Similarly,  we  rewrite  (14)— <16)  in  the  slow  time  scale.  The  resulting 
system  has  the  form  (1)  in  which  the  slow  variables  are  y,  0,  and  and 
the  fast  variables  it  and  if,  whose  derivatives  are  multiplied  by  p,  appear 
linearly  in  these  equations. 

Letting  (i«0,  the  slow  subsystem  of  (12)— <15)  is 


V(x)-P<r,  +  a;p+  j  V;<° 


(28) 


where  the  slow  parts  of  i 4  and  i,  satisfy  the  algebraic  system 


the  subscript  x  denotes  partial  differentiation  and  xt,at  are  the  yth 
components  of  the  vectors  x,a,  respectively.  Without  loss  of  generality, 
we  let  D  be  the  set  whose  boundary  is  given  by  t>,(x)-c0  for  a  fixed 
e0>0. 

Condition  2)  guarantees  that  the  fast  subsystem  (2db)  is  asymptotically 
stable  for  all  x6  D  and  condition  3)  guarantees  that  x*  of  the  slow 
subsystem  (2da)  is  asymptotically  stable  with  D  as  its  domain  of  attrac¬ 
tion. 

Thtortm  I 

Let  D,  be  a  dosed  set  in  the  interior  of  D  and  £  be  a  bounded  set  in 
Km.  If  conditions  l)-3)  are  satisi.ed,  then  there  exists  a  p*  >0  such  that 
for  all  x€D|,  r6£.  the  equilibrium  x»x*,  r— 0  of  system  (25)  is 
asymptotically  stable  for  all  p€(0,M*]. 


dimenstoo.  System  (1)  cob  trolled  by  (34)  bscomm 

x  -/+  J,  (/+  MG"  %)h +l,KO- *1 +(f+  l,H)i  (JS«) 

pz-g+ J,(/+  ifG  *  '*,)*  +  J,ifG  "  fc+(G+ 8j2T)z.  (35b) 
Letting  #i«0,  the  slow  subsystem  of  (35)  is 


OMIMIU 


Theorem  1  is  proved  in  (9]  sad  is  an  essentially  nonlinear  result  For 
the  slow  subsystem,  if  R*(X( a,  (*•))}  <  «j  for  s  fixed  «2  <0,  then  we  can 
always  find  the  required  »>i(x),  while  the  converse  is  not  necessarily  true. 
Consider  the  first-order  system 

xm-x3  (29) 

whose  lineerizatioe  at  x-0  provides  no  asymptotic  stability  information. 
With  F- l/6JrJ,  N -  -2/3,  a  Lyapunov  function  for  (29)  of  the  form 
(27)  is 

».(*)- (30) 

guaranteeing  that  x-0  is  asymptotically  stable.  Hence  Theorem  1  in- 
dudes  a  class  of  essentially  nonlinear  systems  whose  Linearisations  at  the 
equilibrium  may  fail  to  guarantee  asymptotic  stability. 

If  only  the  stability  of  the  equilibrium  is  of  interest,  we  can  relax 
condition  3)  to  the  following  condition. 

4)  There  exists  a  Lyapunov  function  oj(jf)  for  (26a)  guaranteeing  that 
x*  is  asymptotically  stable.’ Furthermore,  let  t>j  be  differentiable  with 
respect  to  x  and  Dj(i)-co>0  for  ail  x  on  the  boundary  of  D. 

Theorem  2 

If  conditions  1),  2\  end  4)  are  satisfied,  then  there  exists  a  p*  >0  such 
that  for  all  pe(0,p*],  the  states  x6Z>|,  r€£  of  (25)  converge  to  a 
sphere  centered  at  the  equilibrium  x-x*,  r-0,  whose  radius  is  0(pX 
The  proof  of  Theorem  2  is  given  in  (8).  In  contrast  to  the  result  of 
Theorem  1,  this  theorem  states  that  x,z  can  only  converge  to  a  sphere 
around  the  equilibrium-  In  the  neighborhood  of  the  equilibrium,  the 
smell  parameter  p  becomes  significant  and  the  behavior  of  x,z  cannot  be 
predicted  by  conditions  2)  and  4).  However,  as  ii-tO*,  the  equilibrium  is 
asymptotically  stable  which  is  the  same  result  as  in  [14].  It  is  important 
to  nose  that  Theorem  I  includes  general  nonlinear  slow  subsystem  as 
indicated  by  condition  4). 


V.  Stabilizing  Controls 

Using  the  rseults  in  the  previous  section,  the  design  of  a  stabilizing 
feedback  control  for  the  full  system  can  be  decomposed  into  separate 
designs  of  feedback  controls  for  the  subsystems.  The  systems  (1),  (4),  (6) 
are  assumed  to  satisfy  the  following  conditions  for  all  x.xSD. 

T)  In  addition  to  condition  IX  the  matrices  B,  and  B2  are  bounded 
and  differentiable  with  respect  to  x. 

20  <7  is  nonsingular  and 

rankl^GF*- (31) 
30  There  exists  a  vector  A( x)eR'  with  A(x*)-0  such  that  the  system 
x»«(x)  +  8(x)A(x)  (32) 

satisfies  condition  3). 

40  System  (32)  satisfies  condition  4). 

Condition  20  guarantees  the  existence  of  a  fast  control  u^Jr.S/)- 
H(x)if  with  H  an  rxm  matrix  and  Re{A(G+ BtH))  <a,  for  a  fixed 
»j<0  such  that  the  feedback  subsystem  (3) 

i,-(G(x)  +  Rj(x)tf(x))x,  (33) 

is  stable.  Condition  40  guarantees  a  stabilizing  control  u-A(jf)  for  the 
slow  subsystem,  and  condition  30  provides  a  stabilizing  control  5- *(jf) 
such  that  the  slow  subsystem  possesses  a  Lyapunov  function  of  the  form 
(27). 

Following  (51  from  the  designs  of  S  and  up  we  consider  a  composite 
control 

x,(x,z)  -  (/+  H  (x)G  - 1 1  (x)8j(x))A(x) 

f#(x)C-'(x)g(x)4»H(x)r  (34) 

for  the  full  system  (1)  where  /  is  the  identity  matrix  of  appropriate 


i  -  (/+ 8, /f G  - 'g )  -  (F+ 8, /f  M  G + )  * '  (  * + JriW  V) 
+(8, -(F+ 8, /fKG+ 8,/f)* '8j)(/+ »G -'*,)* 

-a+BM.  (36) 

Hence  the  following  theorem  follows  immediately  from  Theorems  1  and 

2. 


If  conditions  1— )— 3*)  are  satisfied,  then  there  exists  a  p*  >0  such  that 
for  all  p e(0,p%  x  e 22,,  z  e  £,  the  equilibrium  x»r*,r«0Q(  system  (1) 
controlled  by  (34)  it  asymptotically  stable.  If  only  conditions  10,  20. 
and  40  are  satisfied,  then  there  exists  a  p*  >0  such  that  the  control  (34) 
Steen  all  x 6 D,,  z BE  of  (I)  to  a  sphere  centered  at  x •  x*,  z «*<X  whoee 
radius  is  0(p). 

Thus  we  have  designed  a  composite  control  for  the  full  system  (1) 
based  on  separate  lower  order  designs  of  the  slow  and  fast  subsystems. 
In  the  special  case  when  condition  2)  is  satisfied,  we  let  f/—0  in  (34)  and 
obtain  the  reduced  control 

Mx)-A(x).  (37) 

Then  the  conclusions  of  Theorem  3  hold  for  system  (1)  controlled  by 
(37). 

VI.  Nbax-Opiimal  Control 

A  similar  decomposition  method  is  now  developed  for  the  optimal 
control  of  the  full  system  (I)  with  respect  to  the  performance  index 

r[p(x)+r(x)z + z  Q(x)z  +  u’R (xM dr.  (38) 

■'0 

The  problem  (1),  (38)  satisfies  the  following  condition  for  all  x  €  D: 

1")  In  addition  to  the  scalar  p,  the  vector  seRm,  and  the  matrices 
Q,R  are  differentiable  with  respect  to  x,  />(x*)-0,  j(x*)-0,  Q(x)> 0, 
R(x)> 0,  and  for  rex*,  (# 0 

p+r'r+r'0r>O.  (39) 

Thus  the  optimal  control  should  steer  x,z  to  the  desired  equilibrium 
x-x*.  j«0. 

We  now  extract  from  J  tiro  performance  indices,  one  for  the  slow 
subsystem  (4)  and  the  other  for  the  fast  subsystem  (6X  and  formulate  two 
separate  regulator  problems,  denoted  by  s  for  the  slow  and  /  for  the  fast 
subsystems.  From  the  subsystem  optimal  controls  u  and  up  we  than  form 
a  composite  control  u,  to  be  implemented  to  the  full  system  (1). 


Probltm  3 
Find  5  to  minimize 


/-  J’°[p(x)+s'(x)z  +  z'Q(x)z  +  u'R(x)u]dt 


for  tbs  slow  subsystem  (4). 

Using  (3)  to  eliminate  I  from  (40X  we  obtain 


/*  j  *[/(Jr) + 2S'(x)S+  ffR  (x)i  Jdr 
pmp-,'G-'t+t'C-'QG-'g 

R-R  +  B1G-'QG-'B2. 


(40) 


(41) 


Thtortm  J 


(42) 
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From  condition  1"),  it  follows  that  for  ii1*’,  us* 0 

r(s)+27(x)s+ri[(sys>0-  (43) 

Applying  the  principU  of  optimality  to  problem  i,  we  obtain 

0-min[/(*)+M’(*)fi+5'if(a)5+o,(a(ic)+J  (*)it)  ]  (44) 

when  e  is  the  optimal  value  function  of  (40)  and  t,  its  partial  derivative 
with  respect  to  x.  This  yields  the  mmtmjwiig  control 

WQ»f->(i+£r<)  (<S) 

whose  •Kmittmtirm  from  (44)  results  in  the  Hamilton-Jacobi  equation 
0«(/-l’^”l*)+o,(a— M o(x*)«0.  (46) 


{/-o-p[(r'+2*'K+o,(/-«l/l-,^K)XO-M“*i'')'']4 

4-jtr'Kr  (53) 

satisfies  the  Hamilton-Jacobi  equation  for  the  full  problem  (1).  (31),  to 

0(M). 

The  proof  of  Theorem  4  is  in  [>1(15).  A  series  expansion  of  the 
solution  to  the  Hamiltoo-Jacobi  equation  is  proposed  in  [15],  and  its 
asymptotic  validity  is  bemg  investigated. 

VIL  Niar-Optimal  Control  or  DC  Motor 

We  now  consider  the  optimal-control  problem  of  the  dc  motor  model 
(9)  with  respect  to 

'■fMSMS]**’)*  <M> 


Now  problem  s  is  ssstimed  to  satisfy  the  following  condition. 

5)  The  unique  solution  c(i)>0,  x+x*,  and  o(r')»0  of  (46)  exists 
and  is  differentiable  with  respect  to  x  tot  all  iSD.  Furthermore, 
o(i)-co>0  is  taken  to  be  the  boundary  of  D. 

Then  it  follows  from  condition  5)  that  i^  is  the  unique  optimal 
feedback  control  for  problem  s,  and  o  is  a  Lyapunov  function  of  the 
optimally  controlled  slow  subsystem 

r-s-M-'li+jj'  oi)  (47) 


where  the  scalars  p  >0,  R  >0  and  the  matrix  Q  >0  are  x -independent 
constanta. 

Since  dj-0,  there  is  no  control  in  the  fast  subsystem  (11).  and  hence 
we  only  consider  problem  t  for  the  slow  subsystem  (10).  Eliminating  i 

w<r+*)‘r 

c*+  —*r~ 


establishing  that  x*  is  asymptotically  stable  with  D  u  its  domain  of 
attraction. 

Probkmf 

Find  Uj  to  nunimizA 


*■(?+*) 

C|U* 

“2  '  t,r. 

T,*. 

“-V* 

{*(sfQ(x)*f+yfX(f)*r)*  (4» 

for  the  fast  subsystem  (6). 

Letting  x  be  a  constant  vector  parameter,  the  optimal  control  for  (6), 

(4»  is 


*•  Af  (x)x 

from  (40),  we  obtain 


(55) 

(56) 


-R-'(S)Mi(X)V(S)tf  (49) 

where  V(x)  is  the  positive-definite  stabilising  solution  of  the  x-depen- 
dent  Riccati  equation 

0— K(X)G(X)-0'(J)K(£) 

+  K(x)dJ(jc)A-1(i)di(x)K(jf)-2(x).  (50) 

If  conditions  1")  and  T)  are  satisfied,  then  the  required  stabilizing 
solution  K(x)  of  (50)  exists. 

From  the  solutions  to  problems  i  and  /,  ere  formulate  the  composite 
control  (34)  for  the  full  problem  (1),  (38)  as 


The  optimal  control  for  problem  (10),  (56)  is 

<"> 

Although  subsystem  (10)  is  linear,  /  of  (56)  is  not  strictly  quadratic 
which  results  in  the  nonlinear  feedback  control  u^,  and  the  nonlinear 
feedback  slow  subsystem 


( p+M'QM ) 

rr} 


(58) 


et(x,r)--(/-A-|fliKG-1R2)A-|(r+ jd'o;) 

-R-%VG-'z-R-'BiVt.  (51) 

The  stabilizing  properties  of  u,  then  follow  from  conditions  20  and  5) 
and  Theorem  3.  Implementing  v,  to  the  full  system,  we  have  the 
following  reeult 


If  conditions  1"),  20.  and  5)  are  satisfied,  then  u,  is  an  0(a)  near-opti¬ 
mal  control  in  the  sense  that 

Ut-]A-'(dfl/>idiy;)+0(p)  (52) 

where 


Since  Uf~Q,  from  (51) 

«,(*)-« o(x)  (59) 

and  x -0,  z-0  of  system  (9)  controlled  by  ue  is  asymptotically  stable  as 
(58)  satisfies  condition  3)  and  Re{G(0)}  <0. 

vra.  Conclusions 

A  systematic  procedure  is  given  for  the  order  reduction  and  the 
separation  of  time  scales  in  a  class  of  nonlinear  singularly  perturbed 
systems.  First  the  full  system  is  decomposed  into  two  separate  slow  and 
fast  subsystems.  Second,  the  stability  properties  are  investigated  and 
feedback  stabilising  and  near-optimal  controls  for  the  full  system  (I)  are 
designed  by  analyzing  the  lower  order  subsystems.  Thus  this  procedure  is 
applicable  to  large-scale  systems.  A  dc  motor  and  a  synchronous  genera¬ 
tor  are  need  to  illustrate  the  modeling  aspect  and  the  design  procedure. 
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abstract;  Sufficient  conditions  are  obtained  to  guarantee  the  asymptotic  stability  of  a 
class  of  non-linear  singularly  perturbed  systems.  A  procedure  for  constructing  a  Lyapunov 
function  for  suck  a  doss  of  systems  is  given,  and  a  clearly  defined  domain  of  attraction  of 
the  equilibrium  is  obtained.  A  stabilising  feedback  control  for  such  systems  is  also 
proposed. 

L  bundaettea 

Stability  properties  of  the  non-linear  system 

X~<p  (t,  X,  Z,  p)  /  d\  m 

pi  -  lb  (t,  x,  z,  p)  \  dt) 

where  p  is  a  small  positive  parameter,  x,  «p  e  R"  and  z,  lieR",  have  been 
investigated  extensively  (1-4,  §).  In  this  paper  we  analyze  a  special  class  of 
system  (1)  in  the  form 

i-/(*)+F(x)z,  pz-g(x)+G(x)z  (2) 

which  is  non-linear  in  x  and  linear  in  z.  We  first  consider  stability  properties  of 
the  reduced  system 

i  «  fix )  -  F(x)G“l(x)g(x)  -  a(x) 
zm-G~l  (x)g(x) 

obtained  from  (2)  by  formally  setting  p  ■  0  and  assuming  G(x)  to  be  non¬ 
singular,  and  the  boundary  layer  system 

2~“0,  G(a)z  +  g(a)  <4) 

where  x-a  *  constant  and  s  •(t-t0)/n  with  (q  the  initial  time.  Then  based  on 
the  assumptions  for  (3),  (4),  we  deduce  stability  conditions  for  (2). 


t  This  work  was  supported  in  part  by  the  Energy  Research  and  Development 
Administration  under  Contract  U.S.  ERDA  E(49-18'-2099  and  in  part  by  the  U.S.  Air 
Force  under  Grant  AFOSR  73-2370. 
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In  Sections  II  and  III  conditions  on  systems  t.3)  and  (4)  are  formulated  which 
guarantee  the  equilibrium  of  (2)  to  be  asymptotically  stable  in  a  domain  in 
I?**"*  for  n  sufficiently  small.  Since  system  (2)  is  simpler  in  structure  than 
system  (1),  we  relax  the  condition  used  in  Refs.  (1,  3)  that  the  linearized 
reduced  system  (3)  be  asymptotically  stable.  The  conditions  obtained  here  are 
also  easier  to  apply  to  system  (2)  than  those  given  in  Refs.  (3,  4,  8).  An 
example  is  given  in  Section  IV  and  a  stabilizing  control  for  system  (2)  is 
proposed  in  Section  V. 

IL  Prtiimimarus 

System  Eqs.  (2H4)  are  assumed  to  satisfy  the  following  conditions  for  all 
xsD  where  D  is  a  closed  set  in  R 

(I)  The  vectors  f,g  and  matrices  F.G  are  bounded  and  differentiable  with 
respect  to  .t  and  there  exists  a  unique  x*  £  D  such  that  fix*)  ■  0  and  g(x*) »  0. 

(ID  The  real  parts  of  the  eigenvalues  of  G  are  strictly  negative,  that  is,  there 
exists  a  fixed  <jx<  0  such  that  Re{A(G)}scrl.  Thus  G  is  non-singular. 

(IID  There  exists  a  matrix  Q(x)>0  satisfying  the  x -dependent  aigebraic 
Lyapunov  function 

Q(x)ax(x) + a'x(x)Q(x)  ■  -  C(x)  (5) 

for  some  differentiable  C(x)>0,  where  the  subscript  x  denotes  partial  differen¬ 
tiation  with  respect  to  x  and  the  prime  denotes  the  transpose.  Let  the  matrices 
Mix)  and  N(x)  be 

M(x)  *  20(x)a,(x)  K(x)  (6a) 

N(x)»Qa%4-a;Q+ 7  O^a,  (6b) 

i« t  r-i 

where  1C  is  a  matrix  whose  /th  column  is  (Q^a)  and  xf,  a,  are  the  /'th 
components  of  the  vectors  x,  a,  respectively.  It  is  assumed  that  M  is  bounded 
and  Re  {A(N(x))}soj  for  a  fixed  cr2<0. 

Note  that  in  condition  III,  Q  is  differentiable  with  respect  to  x.  except 
possibly  at  x*  where  it  can  be  unbounded.  However.  Q{x)ax(x)  and 
Q,,(x)a(x),  /■  1,  2,...,  n.  are  required  to  be  bounded  in  the  limit  as  x 
approaches  x*.  For  example  consider 

a(x)--x3.  (7) 

Setting  C(x)  ■?,  we  obtain'Q  » l/(4x1),  - 1  and  N »  -1,  and  condition  III 

is  satisfied  for  all  x  s  R  although  0  is  unbounded  at  x  *  0. 

The  meaning  of  condition  III  is  that  the  reduced  system  (3)  possesses  a 
Lyapunov  function  c(x)  of  Krasovskii's  type  [(5).  (6.  p.  38)],  that  is. 

t?(x)- a’(x)Q(x)a(x)>0.  u(x*'-  0  (8) 

such  that  c.(x) »  a'(Jt)iVf(x)  and 

v(x)m  a'(x)N(x)a(x)<0.  6(x*)  *  0.  (9) 
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Thus  the  equilibrium  xm  of  (3)  is  asymptotically  stable.  Without  loss  of 
generality.  D  is  chosen  such  that  u(x)»c  for  a  fixed  c>0  and  all  x  on  the 
boundary  of  D.  Hence  D  belongs  to  the  domain  of  attraction  of  x*. 

If  Re  {A(a,(jt*))}scrj  for  a  fixed  <rj<0,  then  the  required  Q(x)  always 
exists,  while  the  converse  is  not  true.  Consider  the  system 

x  •  -x3  (10) 

whose  linearization  at  z*  »  0  yields  Re  {A(a,(0))} »  0  and  does  not  guarantee 
that  x*»0  is  asymptotically  stable.  However,  a  Lyapunov  function  (8)  for 
system  (10) 


implies  that  x**0  is  asymptotically  stable.  Hence  condition  III  guarantees  the 
asymptotic  stability  of  essentially  nonlinear  systems  whose  linearizations  at  x* 
fail  to  provide  stability  information. 


ID.  Main  Result 

Theorem  I 

Let  Dl  be  closed  and  in  the  interior  of  D.  and  £  be  a  bounded  set  in  Rm.  If 
conditions  I-m  are  satisfied,  then  there  exists  a  n*  >  0  such  that  for  all  x  6  DL 
ana  t  e  E,  the  equilibrium  x  =*  x*,  z  »  0  of  system  (2)  is  asymptotically  stable 
for  n  €  (0,  /**]. 

Proof:  By  condition  II,  there  exists  a  matrix  P(x)>0  satisfying  the  x- 
dependent  algebraic  Lyapunov  equation 

P(x)G(x)  +  G'(x)P(x)--I  U2) 

where  /  is  the  n  x  n  identity  matrix.  Consider  the  function 

L (x,  z,  *)  -  u  +  J mx  +  G~'g  -  P~x(vxFG~l)'YP(z  +  G~xg  -  P-l(vxFG~lY)  >  0 

(13) 

L(x*,0,  ft)  »0 

with  o  as  given  by  (8).  Then  there  exists  a  p.*  sufficiently  small  such  that  for 
every  jaS(0,  #*T],  L(x,  z.  h)  » c  is  a  closed  surface  S  in  R"~m  enclosing  all 
xs  Du  zsE.  Note  that  for  all  x,  z  enclosed  in  S,  |xj  is  0(1)  and  |z|  can  be  at 
most  0(1  H  u).  The  time  derivative  of  L  with  respect  to  (2)  is 

L-vxx  +  p.(z  +  G"g- TaYPH  +  Rx) +  4/i(z  +  G~'g-  Ta)‘  U(z  +  G-Xg-Ta) 

(14) 

where  T(x)a(x)* P~x[oxFG-xY,  R(x)-tG~xg-p-x(vxFG-lYlc  and  U{x.z)~ 
X'-i  Substituting  (2)  for  x  and  z  and  rearranging,  (14)  becomes 

L  -  a'Ala+i(z^G~'gyA2(z-*-G~xg)-i(z  +  G~xg^iiYay{z^G~xg-iJ.Ya) 

(151 
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where 


At-N-iMrPR  +  R'PD+ifirUT+WrY  (16a) 

Aj  *  -/+ 2#t£/ + 2p(PRF  +  FR'P)  (16b) 

Y»(PRF+U)‘T-PR.  (16c) 

Then  there  exists  a  m*  ^  0  such  that  for  p  e  (0,  p*],  A,  <  0  and  A3<0  since  the 
matrices  T,  P,  R,  F  are  independent  of  p  and  the  elements  of  U  are  at  most 
0  (1/Vfi)  for  all  x,  z  enclosed  in  S,  implying  that  L<0  and  L(x*,0,  ji)*0. 
Thus  choosing  p*  *  min  (p*,  p*),  L  is  a  Lyapunov  function  for  (2)  and  x  *  x*, 
r  »  0  is  asymptotically  stable  for  all  p  e  (0,  /a*]  with  its  domain  of  attraction  of 
attraction  enclosed  by  S. 

The  accomplishment  of  Theorem  I  is  threefold.  First,  condition  HI  replaces 
the  more  restrictive  condition  Re  {A(a,)}s  or3  proposed  in  Refs.  (1,  3)  for  the 
general  system  (1).  Second,  Theorem  I  formulates  a  procedure  to  construct  a 
Lyapunov  function  for  (2)  and  provides  an  estimate  of  p*.  Third,  the  domain 
of  attraction  of  the  equilibrium  x  *  X*.  z  »  0  is  clearly  defined.  A  similar  result 
can  be  obtained  for  system  (2)  where  /,  g,  F.  and  G  are  also  functions  of  t. 


/V.  Example 

Consider  the  second  order  system 

x*x-xJ  +  z,  fii»-x-z  (17) 

whose  reduced  system  is 

x»-x3,  z»-x  (18) 


which  is  the  same  system  as  (10).  Using  (ID,  we  construct  (13)  to  be 

L  -hx*+lp(z  +  x  +  2x3)2  (19) 

whose  time  derivative  with  respect  to  (17)  is 
L  »(-l  +  fi(l  +  6xs)  +  jiI  f(l  +  6x2)2)x4 

+  K- 1  +  2f*(l  +  6x2))(z  +  x)2  -i(r  -r  x  +•  3  px}{  1  +  6x2))2.  ( 20) 


Note  that  »  ■  x2  is  also  a  Lyapunov  function  guaranteeing  that  x  *0  of  (18)  is 
asymptotically  stable.  However,  if  it  were  used  in  L  instead  of  (11).  L  would 
not  have  been  a  complete  square  form.  In  the  region  |x|sV2,  p.*=>0.01  is 
sufficient  to  guarantee  that  L  <  0,  and  hence  L  is  a  Lyapunov  function  for  (17) 
for  p  s  (0, 0.01].  The  closed  contours  generated  by  L  *  1  for  p=*  0.01  and 
p  *0.005  are  shown  in  Fig.  1,  where  the  domain  of  attraction  is  larger  for 
p  ■  0.005  as  indicated  in  the  proof  of  Theorem  I. 
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F:o.  1.  Contours  of  L  »  1  for  n  *0.01  and  n  *0.005. 

V.  Application  to  Control  Systems 

Theorem  I  is  now  applied  to  the  design  of  a  stabilizing  control  usR'  for  the 
system 

x  ~f(x)  +  F(x)z  +  Bl(x)u 
lxz**g{x)  +  G(x)z  +  B2{x)u. 

Formally  letting  n  »0,  the  reduced  system  of  (21)  is 

*  m(f- FG~lg)  +  {Bl-FG~lBz)uma-r  Bu.  (22) 

Systems  (21)  and  (22)  are  assumed  to  satisfy  the  following  conditions  for 
xeD: 

(V)  In  addition  to  condition  I,  the  matrices  Bt  and  B2  are  bounded  and 
differentiable  with  respect  to  x. 

(IT)  G  is  non  -singular  and 

rank  [Bj,  GBj, . . . ,  m.  (231 
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(LUO  There  exists  a  vector  h(x)  e  R'  with  h(x*) »  0  such  that  condition  m  is 
satisfied  with  a(x)+ B(x)h(x)  replacing  a(x). 

By  condition  IH',  there  exists  a  stabilizing  feedback  control  u(x)  •  h(x)  for 
the  reduced  system  (221  such  that  the  feedback  controlled  system 

x  ■  a  +  Bh  (24) 

possesses  a  Lyapunov  function  of  the  form  (8)  guaranteeing  that  x  *  x*,  z  ■  0 
is  asymptotically  stable.  Again  we  assume  that  D  is  the  closed  domain  of 
attraction.  From  the  reduced  control,  we  formulate  a  stabilizing  feedback 
control  for  (21). 

Corollary  1 

If  conditions  I'-ffl'  are  satisfied,  then  there  exists  a  fi*>0  such  that  for  all 
x  s  Dlt  z  s  £,  and  m  e  (0,  ***],  the  equilibrium  x  *  x*,  z  ■  0  of  the  system  (21) 
controlled  by 

u(x,  z)  -  (/+ H(x)G~l(x)B2(x))/«(x)+H(x)G-l( x)g(x)  +  H(x)z  (25) 

where  Re  {A(G-t-B2H)}s<r4  for  a  fixed  cr4<0,  is  asymptotically  stable. 

Proof :  Since  condition  IT  is  satisfied,  we  can  find  H(x)  such  that 
Re  {A(G  +  B2H)}s<7*<0.  Thus  system  (21)  controlled  by  (25)  becomes 

x.-f+Bx  (i+HG-1B2)/«  +  B1HG-1g  +  (F+BlH).r 
*ii-g  +  B2  (/+HG-lB1)/t-B2;/G-'g-(G-rB2H)z. 

Letting  ft ■  0,  the  reduced  system  of  (26)  is 

x  -  (/+  BxHG"‘g)  -  (F+  Bt  H)(G  +  BjHTHg  ■ +  BzHC~lg) 

+ (Bj  -  (F+  BXH)(G  +  B2H)-xBJ{I + HG~lBi)h  (27) 

*  a  +  Bh 

by  using  a  simple  algebraic  manipulation.  Hence  from  condition  III',  (27) 
possesses  a  Lyapunov  function  of  the  form  (8)  and  by  Theorem  I,  the 
equilibrium  x  *  x*,  z  »  0  is  asymptotically  stable. 

Corollary  1  outlines  a  low  order  design  where  the  reduced  system  and  the 
boundary  layer  system  are  considered  separately.  In  addition,  the  parameter  m 
is  not  required  to  be  known  exactly  provided  that  it  is  sufficiently  small.  The 
result  here  is  a  generalization  of  the  design  obtained  for  linear  time-invariant 
singularly  perturbed  systems  H). 

VL  Conclusion 

In  this  paper  we  have  presented  sufficient  conditions  to  guarantee  the 
asymptotic  stability  of  a  class  of  nonlinear  singularly  perturbed  systems.  For 
such  a  class  of  systems,  we  have  given  a  procedure  for  constructing  a  Lyapunov 
function,  and  a  clearly  defined  domain  of  attraction  of  the  equilibrium  is 
obtained.  We  have  also  proposed  a  stabilizing  feedback  control  for  such 
systems. 
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Optimal  Open-  and  Closed-Loop  Control  of 
Singularly  Perturbed  Linear  Systems 

ROBERT  R.  WILDE,  uzmber,  an,  and  PETAR  V.  KOKOTOVlC 


Abstract — A  simple  method  is  given  to  obtsin  either  sn  ipprexi- 
mste  open-  or  closed-loop  control  or  sn  approximate  solution  to  the 
linear  quadratic  fixed  and  free  endpoint  optimal  control  problems. 
This  approximation  is  valid  over  the  entire  time  Interval,  or  with 
further  computational  reduction,  only  on  the  open  interval:  Emphasis 
is  placed  on  use  of  control-oriented  hypotheses,  practical  aspects  of 
implementing  the  approximate  controls,  and  interpretation  of  these 
controls.  The  approximating  design  procedure  given  is  illustrated 
through  examples  which  clarify  and  demonstrate  it 

Introduction 

SINGULAR  perturbation  theory  can  often  be  applied  in 
solving  linear  quadratic  fixed  and  free  endpoint 
optimal  control  problems.  First,  however,  it  is  necessary 
for  the  control  engineer  to  decide  if  his  particular  system 
equations  are  of  the  singularly  perturbed  form.  If  small 
coefficients  multiplying  derivative  terms  in  the  system 
equations  such  as  those  representing  capacitances,  in¬ 
ductances,  time  constants,  or  other  small  parasitic  param¬ 
eters  are  present  or  if  such  coefficients  within  the  system 
are  separated  by  at  least  an  order  of  magnitude,  then  it  is 
highly  probable  that  singular  perturbation  theory  can  be 
applied.  It  remains  only  to  verify  that  the  hypotheses  of 
such  theorems  are  satisfied. 

The  small  derivative  coefficients,  expressible  as  the 
product  of  a  small  positive  scalar  a  and  an  appropriate 
constant,  are  responsible  for  creating  a  “stiff”  system  of 
differential  equations  which  is  difficult  to  solve  using 
existing  methods.  An  additional  complication  of  singularly 
perturbed  systems  considered  here  is  that  both  widely 
varying  decay  transients  and  widely  varying  growth 
transients  are  present  as  compared  with  only  the  decay 
transients  implied  by  the  stiffness  of  the  system. 

Use  of  singular  perturbation  theory  provides  the 
engineer  with  a  simple  means  to  obtain  either  an  approxi¬ 
mate  open-  or  closed-loop  control  or  an  approximate 
solution  to  the  original  system.  The  approximation  ob¬ 
tained  results  from  the  solution  of  a  lower  order  system 
than  the  original.  Not  only  is  the  system  order  reduced, 
but  the  stiffness  behavior  is  also  eliminated.  If  the  given  n 
is  sufficiently  small,  the  approximate  solution  or  control 
will  be  close  to  the  actual.  The  smaller  n  is,  the  closer  the 
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approximation.  This  approximation  is  valid  over  the 
entire  time  interval  including  both  initial  and  terminal 
times,  or  with  further  computational  reduction,  only  on 
the  open  interval.  While  there  is  no  easy  test  to  determine 
the  bound  on  a  so  that  one  knows  in  advance  if  m  is 
sufficiently  small,  the  smallness  criterion  can  be  checked 
by  other  means.  This  can  be  done  by  using  techniques  such 
as  utilizing  physical  intuition  of  the  original  system,  test¬ 
ing  the  approximate  control  in  the  original  system  to 
determine  if  the  predicted  approximate  results  are  ob¬ 
tained,  or  checking  to  determine  if  a  Lyapunov  function 
such  as  in  [13  ]  satisfies  required  properties  for  stability. 
Once  it  has  been  determined  that  /t  is  sufficiently  small, 
the  approximation  could  be  utilized,  for  example,  to  save 
computer  memory  and  computation  time  by  using  low 
order  approximate  equations  in  place  of  the  high  order 
original  system  equations.  For  a  system  required  to  be 
solved  in  real  time  on  a  minicomputer,  the  reduction  in 
order  of  the  system  could  mean  the  difference  between 
feasibility  and  impossibility  of  implementation. 

Although  higher  order  approximating  expansions,  for 
which  the  theory  developed  here  applies  but  which  are  not 
formally  presented  in  this  paper,  are  often  given  for  the 
control  or  solution  to  such  problems,  they  appear  more  of 
an  interest  from  a  theoretical  development  than  in  applica¬ 
tion.  It  is  felt  that  problems  requiring  expansions  greater 
than  second  order  are  better  suited  for  solution  by  other 
techniques.  It  is  noted  that  increasing  the  number  of 
expansion  terms  in  no  way  implies  that  the  constant  n,  the 
value  of  which  is  defined  for  a  physical  system,  will  be 
small  enough  to  apply  singular  perturbation  theory  if  it 
was  not  originally,  even  though  this  possibility  exists. 

This  paper  presents  a  thorough  treatment  of  the  sin¬ 
gularly  perturbed  fixed  and  free  endpoint  optimal  control 
problems  with  linear  quadratic  performance  indices  by 
considering  both  open-  and  closed-loop  controls,  require¬ 
ments  for  the  implementation  of  these  controls,  and  inter¬ 
pretation  of  the  form  of  the  controls.  Emphasis  is  placed 
on  the  development  of  a  new  theory:  one  that  is  applicable 
to  the  solution  of  the  fixed  and  free  endpoint  problems, 
regardless  if  an  open-  or  closed-loop  control  is  desired,  and 
one  of  great  significance  because  interpretation  of  the 
equations  and  results  is  possible  which  is  readily  under¬ 
stood  by  control  engineers.  This  theory  uses  a  dichotomy 
transformation  to  separate  the  original  optimal  problem 
into  two  free  endpoint  problems  where  the  latter  prob¬ 
lems,  unlike  the  original,  can  be  solved  using  initial  value 
singular  perturbation  theory.  The  initial  value  singular 
perturbation  theory  is  first  applied  to  the  Riccati  equation 


WILD E  AND  KOKOTOV ic:  SINGULARLY  PERTURBED  LINEAR  SYSTEMS 


and  then  to  the  controlled  plant.  The  transformation  can 
also  be  seen  as  a  method  to  separate  a  two  point  boundary 
value  problem  into  two  initial  value  problems.  The 
dichotomy  transformation  is  used  in  the  feedback  form  of 
the  free  endpoint  problem  to  show  that  when  the  approxi¬ 
mate  feedback  control  is  inserted  in  the  higher  order 
system,  a  solution  close  to  the  original  solution  results 
and  is  valid  over  the  entire  time  interval  [U>,T\ — the  degree 
of  closeness  depending  on  the  smallness  of  it-  This  is 
neither  done  nor  is  possible  using  the  approach  given  in 
(4], [15],  which  substantially  extended  the  theory  given  in 
[9].  To  make  the  theory  most  useful  to  control  engineers, 
control-oriented  hypotheses  are  given.  Use  of  a  different 
theory  for  solution  of  the  singularly  perturbed  free  end¬ 
point  problem  is  presented  in  [8],  but  the  result  and 
corresponding  hypotheses  are  strictly  mathematically 
oriented  and  applied  only  for  the  optimal  open-loop  con¬ 
trol.  Other  papers  in  the  general  area  include  [3],  [7],  [12], 
[16].  To  clarify  and  demonstrate  the  theory,  a  simple 
design  procedure  with  illustrative  example  is  given.  The 
reader  interested  in  applying  the  theory  needs  only  to 
read  the  theorems  and  associated  discussions  since  the 
theorems  contain  the  design  procedure. 

Problem  Statement 


noted  by  S.  It  is  then  seen  that  x(t,u),  \(t,it)  must  satisfy 


and  boundary  conditions  (3)  and  (4).  Similarly,  the  control 
u  is  given  by 

u  -  (6) 


When  n  is  set  equal  to  zero  in  (5),  its  order  reduces  from 
2(ni  +  Hi)  to  2ni.  Thus  (3)-(5)  constitute  a  “singularly 
perturbed”  two  point  boundary  value  problem.  The 
reduced  probl  m  is 


subject  to  (3)  if  the  indicated  inverse  exists.  The  remaining 
variables  £i  and  \2  are  algebraically  related  to  and  Xt  by 


and,  in  general,  i2  does  not  satisfy  (4).  The  corresponding 
reduced  control  is  then 


Consider  a  control  system 


u  - 


(9) 


*i"|  f  An(t,it)  AvMlUl  ["5i(f,M)T 

Jtiij  "r 


(1) 


where  X\,  x%,  and  u  are  nt~,  nr,  and  wi-vectors,  respectively, 
and  it  is  a  small  positive  scalar.  For  brevity,  (1)  is  re¬ 
written  as  follows: 


-  Ax  +  Bu,  /„  -  £0 


(D 


where  I\  and  /2  are  «»  X  nt  and  n-  X  n2  identities.  Also, 
arguments  of  functions  are  dropped  when  no  confusion 
results,  and  a  bar  is  used  to  indicate  that  u  =  0.  Thus  An 
denotes  .4H(f,M),  and  ,4U  *  An(t)  denoces  Ah(<,0). 

The  first  problem  to  be  studied  is  the  minimization  of 

J  —  1  J  [ x'Qx  +  u’Ru]  dt  (2) 

with  x  ~  x(l,/t)  specified  at  both  U,  and  T  as 

Xi(to,u)  -  V,  xi(T,n)  -  z,T  (3) 

Xt(U»u)  -  xt°,  Xt(T,it)  -  xjT.  (4) 

In  the  second  problem,  x(T,it)  is  free,  and  a  terminal  cost 
is  added  to  (2). 

Given  a  p*  >  0,  the  following  hypothesis  is  made : 

Hypothesis  1:  For  all  <E[fo,T]  and  mE  [0,p*],  the  ele¬ 
ments  of  .4,  B,  Q,  and  R  are  twice  continuously  differ¬ 
entiable  functions  of  t  and  u,  R  is  symmetric  positive 
definite,  and  Q  is  symmetric  positive  semidefinite. 

In  the  standard  necessary  optimality  conditions,  the 
adjoint  variable  X  is  replaced  by  7„X,  and  BR~lB’  is  dc- 


Equations  (7)-(9)  could  also  have  been  dev»-!ofied  from  the 
reduced  optimal  problem  defined  by  (1)— (3)  where  u  is 
first  set  equal  to  zero. 

Of  particular  interest  is  when  the  reduced  solution  x(t) , 
X(0  car  approximate  the  actual  solution  x{t,n),  on  an 
open  interval  of  [<o,T]  for  u  sufficiently  small.  Since  i2(f) 
can  violate  (4),  large  discrepancies  or  "boundary  layers” 
are  anticipated  at  the  ends  of  the  interval.  Layer  correction 
terms  must  thus  be  added  to  the  reduced  solution  for  the 
approximation  to  be  valid  over  the  entire  interval.  Since 
the  boundary  layers  result  from  the  fast  transients  of 
x{t,it),  \{t,it),  it  is  important  that  the  correction  terms  be 
obtained  separately  from  £(t),  X(f)  in  a  “stretched"  time 
scale.  The  crucial  hypothesis  of  the  time  scale  separation 
method  used  here  is  that  system  (1)  be  boundary  layer 
controllable  and  boundary  layer  observable.1 

Hypothesis  2:  For  all  lE[<o,T], 

rank  [5j,Ajj5j, •  ■  *  nt 

rank  [6W6V  •  -  m 

where  Ci  satisfies  Ct'Ci  =» 

Here  Hypothesis  2  guarantees  the  existence  of  the  inverse 
in  (7)  and  (S)  and  also  will  allow  the  systems  from  which 
the  boundary  layer  terms  are  obtained  to  be  stabilized. 


1  A  less  restrictive  stabilizability  condition  can  be  assumed  but 
adds  unwanted  complexity  to  the  subsequent  proofs.  It  is  readily 
apparent  from  the  proof  of  the  subsequent  theorem  that  the  theorem 
applies  to  the  problem  J  -  i/oT  u*  di,  ait  «  xi  +  u,  and  x*\  xtr 
specified.  Here  Hypothesis  2  is  not  satisfied.  See  [5]  for  a  further 
discussion  on  stabilizability. 
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Fundamental  Result 

The  time  scale  separation  method  is  based  on  a  theorem 
which  defines  an  0(m)  approximation2  of  the  exact  solution 
x(t,n),  \(t,n).  The  formulation  of  the  theorem  is  done  in 
such  a  way  to  provide  the  steps  of  a  design  procedure  to  be 
discussed  in  the  next  section.  The  rigorous  proof  is  post¬ 
poned  until  a  later  section. 

Theorem: 

1)  Assume  that  Hypotheses  1  and  2  hold  and  that  £(f), 
X(l)  exists  and  is  the  uniquely  defined  reduced  solution 
satisfying  (7)  with  boundary  condition  (3). 

2)  Let  P~  and  be  the  positive  and  negative  definite 
symmetric  roots,  respectively,  of  the  algebraic  equation 

KttAa  +  Aa'Ka  ~~KttSnKn  +  Qtt  ■*  0  (10) 

for  all  t€[<o,T]. 

3)  Let  -C(r)  and  <R(o)  be  the  solutions  of  the  two  mu¬ 
tually  independent  time  invariant  initial  value  problems 


~r  *  W«(fo)  —  Sn(to)Pn(to)]£(r)  (11) 
dr 

£(0)  -  x,°  -  St(lo)  (12) 

and 

»  IMT)  -  S*(T)$n(T)M<,)  (13) 

da 

<R(0)  *  x2r  -  it(D-  (14) 

4)  Let  ‘Ut(r)  and  fiisM  be  the  “left”  and  “right”  boun¬ 
dary  terms  defined  by 

•Ui(r)  -  -/?-'(W5t'(t»)i»a(<,)£(r)  (15) 

U»(*)  »  -«-‘(r)A'(r)AVB(T)<R(»).  (16) 

Then  there  exists  n*  >  0  such  that  for  all  IGtZo.F], 
mG(0,m*] 

XiM  -  *i«)  +  0(m)  (17) 

x,«.M)  -  *t(t)  +  £(r)  +  «(»)  +  00.)  (18) 

Xi M  -  MO  +  0(m)  (19) 


-  MO  +  Pa(t) £(t)  +  $n(t)(R(a)  +  0 (m)  (20) 

and 

«(«,/*)  -  a(t)  +  ‘Ui(r)  +  %„(a)  +  0(m)  (21) 

where  r  *  (t  —  U>)/n  and  <r  —  (t  —  T)/n  which  define  the 
“stretched”  time  scales. 

Remark:  Hypotheses  1  and  2  guarantee  that  Pa  and 
-Vj,  defined  in  2)  exist  and  are  unique  and  that  (An  — 
SnPn)  and  —  (.■?-?  —  Sn-^n)  are  stable  matrices2  for  each 
<G[*oT].  Hence  the  norm  of  £(r)  is  bounded  by  an  ex- 

5  A  scalar,  vector,  or  a  matrix  function  on  an  interval  [(«,?] 
is  Mm)  if  there  exist  positive  constants  a  and  m’  such  that  the  norm 
of /satisfies  i/I  <  a»for  all 

'  A  stable  matrix  is  one  in  which  the  real  parts  of  all  its  eigenvalues 
ore  less  than  a  fixed  negative  number. 


ponentially  decaying  function  of  r.  In  f-seale,  the  decay  is 
very  rapid  since  its  time  constant  is  0  (m).  The  same  is  true 
about  the  decay  of  (R (<r)  in  (T  —  ()-scaIe.  Therefore,  (12) 
and  (14)  are  in  agreement  with  (18).  Equation  (10) 
possesses  a  unique  symmetric  positive  definite  solution 
P 21,  and  (/?«  —  SnPn)  is  a  stable  matrix  for  each  ZG  [<o,T] 
as  is  evident  from  the  solution  to  problem  (22)  where  to  is 
replaced  by  Z  in  (22).  A  solution  to  problem  (22)  is  guaran¬ 
teed  to  exist  as  a  consequence  of  Hypotheses  1  and  2 
[1,  p.  785].  A  similar  result  holds  for  the  negative  definite 
case  using  [14].  Also,  within  an  00.)  approximation, 
Pn(t)£(r)  can  be  replaced  by  Pa(to)£(r)  and  .Va(f)<R(<r) 
by  $a(T)6l(a) ;  that  is,  a  simplified  form  of  (20)  is 

X,(«,m)  -  +  Pn(to)£(r)  +  $n(T)M(a)  +  0(m).  (20') 

Similar  simplifications  based  on  a  rapid  decay  of  £(r)  and 
(R (a)  are  made  throughout  the  text.  Also  it  is  noted  that 
assumption  1)  of  the  theorem  is  sufficient  for  guaranteeing 
the  existence  of  a  solution  to  the  problem  (3)-(5)  for 
mG(0,m*1,  which  in  turn  implies  its  optimality. 

Discussion 

In  applications  of  the  theorem,  the  two  major  jobs  are 
first,  to  solve  the  reduced  problem  and  second,  to  obtain 
the  layer  correction  terms.  The  time  scales  for  these  two 
operations  can  be  selected  to  be  independent.  For  the 
reduced  problem,  a  standard  two  point  boundary  value 
technique  is  used.  The  advantage  over  the  original  problem 
is  that  the  order  is  lower,  and  the  fast  phenomena  due  to  m 
are  eliminated. 

The  xt  boundary  layer  correction  terms  £  and  (R  are 
interpreted  as  the  solutions  of  two  time  invariant  regulator 
problems  in  stretched  time  scale.  The  £  problem  is 

J  =»  (£'Q*(U>)£  -+•  tU'.£(fo)tU)  dr 

d£, 

-7-  -  An(k)£  +  (MTl,  J2(0)  -  Xj°  -  x2(fo),  (22) 
ar 

and  the  (R  problem  is 

/  -  J*°  (<R'Qn(T)<R  +  %'R(T)%)  da 

X  *  Aa(T)( R  +  5j(7T)<U,  <R(0)  »  x2T  -  S2(T)  (23) 

da 

where  the  minimizing  controls  are  (15)  and  (16),  respec¬ 
tively.  Hence,  the  original  optimal  control  problem  (l)-(4) 
has  been  divided  into  three  optimal  control  problems  for 
x2:  TXi,  (15),  forces  x2  to  rapidly  approach  x2  in  the  initial 
boundary  layer;  S,  (9),  results  in  x2  being  close  to  i2  except 
at  the  ends  of  the  interval;  and  tU„,  (16),  forces  x2  to  rapidly 
separate  from  to  attain  its  terminal  condition  in  the  final 
boundary  layer.  Only  fi  is  needed  for  the  x2  variable.  Con¬ 
trol  stabilizes  the  left  boundary  layer  even  if  unstable 


Wtl.DE  AMD  KOKOTOVIC:  3INOULABLY  PERTURBED  LINEAR  SYSTEMS 


modes  are  present  in  Aa(W ;  i.e.,  eigenvalues  with  positive 
real  parts.  Likewise,  a  similar  statement  holds  for  <U«. 

In  actual  application,  the  desired  results  will  not  always 
be  obtained  if  the  approximate  control  given  by  (21)  with 
00*)  equal  to  zero  is  inserted  into  the  original  system  (1), 
as  also  observed  by  Dr.  P.  Sannuti.  Undesirable  results 
occur  when  unstable  modes  are  present  in  Aa.  It  is  well 
known  that  the  stability  of  a  system  is  not  affected  by  an 
open-loop  control.  A  perturbed  initial  condition  in  x,  from, 
for  example,  a  disturbance  or  noise  will  result  in  an  error. 
This  error  increases  with  time  and  gets  worse  as  a  gets 
smaller:  e.g.,  the  solution  corresponding  to  a  perturbation 
in  the  initial  condition  of  a*  -  z,  z(<o)  ■  0  is  to  »  e'^to*. 
Now  assume  such  disturbances  and  noise  can  be  disre¬ 
garded.  Contrary  to  expectation,  it  frequently  is  the  case 
that  the  closer  the  approximation,  the  further  one  is  from 
the  optimal  response.  Possibilities  existing  for  the  solution 
of  (1)  due  to  the  approximate  open-loop  controller  are: 
closeness  to  the  optimal  solution  everywhere,  closeness 
except  in  the  boundary  layer,  or  divergence  from  it  as  a 
becomes  smaller.  These  problems  can  be  circumvented  by 
using  a  combination  open-  and  closed-loop  controller  of  the 
form  u  m  Mu  4-  v  where  M  is  chosen  such  that  the  result¬ 
ing  coefficient  matrix  (An  4-  BtM)  of  xi  in  the  a*2  equation 
of  (1)  be  stable.  Hypothesis  2  guarantees  the  existence  of 
such  an  M.  Having  determined  M  and  the  approximate  Xt 
and  u  solutions  given  by  (18)  and  (21),  respectively,  v  can 
then  be  found  from  the  combination  controller  equation. 
Requiring  also  that  the  boundary  layer  solution  (22)  be 
optimal  for  each  fixed  Z(=  [<o,T],  where  to  has  been  replaced 
by  /,  requires  M  be  equal  to  (  —  Hence,  the 

combination  open-  and  closed-loop  controller  is  given  by 

u  -  a*,  +  v.  (24) 

Details  of  the  time  8cale  separation  design  procedure 
and  the  development  of  the  approximate  control  in  the 
case  of  unstable  modes  are  illustrated  through  example. 
The  first  example  illustrates  steps  (1)— (20)  of  the  pro¬ 
cedure.  The  system,  the  performance  index,  and  the 
boundary  conditions  are 

ii  -  xt 

nxt  -  lx t  +  u  (El)4 

J  -  J  J2  (*!*  4-  (9  -  tW  +  m!1  «M  (E2) 

*i(M  -  *i(2,m)  =  *ir  (E3) 

Xi(l,a)  *  xi°,  x>(2,a)  =  xjr.  (E4) 

Since  An  =  t,  Bj  —  1.  and  Qti  »  9  —  f2,  Hypothesis  2 
holds  for  0  <  t  <  3.  The  exact  optimal  solution  must 
satisfy 


*  For  convenience,  equation  numbers  are  kept  the  same  as  in  the 
main  text,  and  "E”  refers  to  “example.’’ 


*l  ■  Xi 

ItXt  -  txt  —  \t 

Xi  -  -Xi 

aX t  ■  -  (9  -  t*)x t  -  X,  -  (X.  (E5) 

subject  to  (E3),  (E4).  When  a  is  set  equal  to  zero,  the 
reduced  problem  is 

it  ”  —  iXj 

Xi  -  (E7) 

subject  to  (E3).  Its  solution  Xt(t),  Xi (/)  is  easily  found  using 
the  eigenvalues  Ji  *  i  and  h  *  —  J  of  the  system  matrix 
in  (E7).  To  complete  the  first  part  of  the  procedure,  Xt  and 
Xt  are  evaluated  from 


Xt  = 


(E8) 


In  the  second  part,  the  Riccati  equation  is 

2 Knt  -  Kn1  4-  (9  -  fl)  -  0  (E10) 

and  its  roots  are 


Px(t) 

The  use  of  P&(  1) 


t  4-  3,  .V„«) 

4  in  (11)  yields 
d& 

dr 


-3£; 


3. 


(Ell) 


hence, 

£  -  [xt°  -  *t(l)]e-3(,-l)/*. 
Similarly,  when  l?jj(2)  *  —  1  is  substituted  in  (13), 


—  -  3(51 

do  (E13) 

<R  -  [x/  -  x>(2)  }e3(‘--)/u. 

The  approximation  (17)-(20)  can  now  be  formed.  Con¬ 
sider  only  its x  part: 

xi(f,a)  -  c,e-'/3  4-  cte,/s  4-  00*)  (E17) 

x,(f,a)  ~  cte-1'3  +  c4e‘/3  +  cje-3(<_1)/M  + 

4-  00*)  (E18) 


where  ci,-  •  -  ,c«  are  known  constants.  Note  that  (E1S)  has 
four  modes  whose  time  constants  are  ±3,  ±a/3.  The  layer 
correction  modes  are  9/a  times  faster  than  those  of  the 
reduced  solution,  and  for  a  *  0.01,  the  ratio  of  the  time 
constants  is  900.  Does  the  exact  solution  possess  this 
“two-time-scale”  property?  Fortunately,  the  explicit 
solution  of  the  time  varying  system  (Eo)  is  readily  avail¬ 
able  for  comparison.  Its  x2  solution  is 


Xj((,a)  m  die"1  4-  ate’'1  4-  cue'11  4-  cue*'1 


where  constants  oi,-  •  ■  ,a<  may  depend  on  a,  and  «i,-  •  -  ,s4 
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are  the  roots  of  the  characteristic  equation 

/i1*4  —  (m  +  9)«*  +  1  *»'0. 

It  can  easily  be  shown  that 

3 

+  0(/a);  s»,s4  »  ±  -  +  0(ji). 

n 

Hence,  the  time  constants  of  the  modes  in  (E18)  indeed 
represent  an  0(m)  approximation  of  the  time  constants 
of  the  exact  modes. 

The  second  example 

it  «■  1.5*i 

nit  m  —1.5*i  +  0.5*j  —  u  (25) 

J  =  f  (2*!*  +  +  i«3)  dt  (26) 

Jo 

*1°  -  4,  *,«  -  3,  XyT  -  0.5,  *jr  —  —1.3  (27) 

is  used  to  demonstrate  the  closeness  and  composition  of  the 
approximate  *2  as  defined  in  (18)  with  0(ji)  set  to  zero  as 
well  as  to  illustrate  the  results  using  both  an  open-  and 
closed-loop  approximating  control  in  (25).  In  Fig.  1, 
m  ”  0.1,  and  the  way  in  which  the  approximate  solution  is 
formed  from  both  the  reduced  solution  and  the  layer 
corrections  is  apparent.  Without  layer  correction  £(r), 
the  error  at  t  »  0  would  be  as  large  as  9.6,  while  with 
£(r),  the  maximum  error  is  1.5  and  occurs  at  t  *  0.2. 
For  n  *  0.01,  the  approximate  and  the  exact  solutions 
shown  in  Fig.  2  are  virtually  identical,  and  their  behavior 
at  t  »  0  and  t  »  1  is  a  pictorial  justification  for  the  term 
“boundary  layer.”  The  dotted  curve  in  Fig.  3  illustrates 
the  divergence  characteristic  which  results  when  the  con¬ 
trol  given  by  (21)  with  0(ji)  equal  to  zero  is  inserted  in 
original  plant  (25)  which  possesses  an  unstable  mode: 
i.e.,  the  eigenvalue  of  An  *  0.5.  The  divergence  increases 


as  n  decreases!  By  selecting  the  combination  open-  and 
closed-loop  controller 

u  “  2*t  +•  v  (28) 

defined  by  (24),  plant  (25)  no  longer  possesses  an  unstable 
mode  in  An  upon  substitution  of  this  control  there.  The 
theorem  can  now  be  applied  in  a  straightforward  manner 
to  find  the  open-loop  optimal  control  v  in  the  form  of  (21). 
The  dot-dash-dot  curve  in  Fig.  3  shows  the  resulting  xt 
solution.  Observe  how  close  the  approximation  is. 

Proof  of  Theorem 

In  the  proof,  the  two  point  boundary  value  problem  for 
(5)  is  transformed  into  two  initial  value  problems.  The 
transformation  involves  positive  and  negative  definite 
solutions  of  a  Riccati  equation  whose  properties  are  now 
reviewed.  Let 

\  -  K"x,  K"  -  [*»  **£“]  (29) 

and  note  that,  in  view  of  (5),  K "  satisfies  the  singularly 
perturbed  Riccati  equation 

I,K"  -  -K"A  -  A’K"  +  K"'SK"  -  Q.  (30) 

It  is  well  known  that  Hypothesis  1  guarantees  the  exis¬ 
tence  and  uniqueness  of  a  solution  to  (30)  for  /£  [to,T]  and 
n  >  0  if  K"(T,n)  =*  IP  where  Ijl*  is  symmetric  positive 
semidefinite  for  all  m€[0,m*1,  and  IP  is  defined  by  (29) 
where  II„  replaces  K„.  Furthermore,  is  sym¬ 

metric  positive  definite  except  possibly  at  l  =  T  where  it 
can  be  semidefinite  if  IJl"  is.  For  n  **  0,  the  («,  -j-  >»*)  X 
(n i  +  ni)  differential  equation  (30)  reduces  to  one  nt  X  rq 
differential  equation  and  two  algebraic  equations 
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ifii  =  —Kn(Au  —  SkKu')  —  (Au  —  SuKn)Kii 

—  —  An'Ka'  4*  KaSnKii 

+  KnSxKu'  —  Qu  (31) 
0  =»  ~Kn(Aa  —  SnK-a)  —  +  KuSuKzi 

—  Ati'Kn  —  Qu  (32) 
0  »•  —  KhAk  —  Ak'K-u  +•  K^SaKn  —  Q-n-  (33) 


Notice  that  (33)  is  identical  to  (10)  and  independent  of 
(31)  and  (32).  In  [4]  it  was  shown  that  Hypotheses  1  and 
2  guarantee  the  existence  of  a  unique  P,t  solution  to 
(31)— (33)  subject  both  to  Pu(T)  =  Au.  where  Au  is  an 
arbitrary  nt  X  «i  symmetric  positive  semidefinite  matrix, 
and  to  Ps  being  the  unique  symmetric  positive  definite 
solution  of  (33).  For  this  case,  Pn(t)  is  a  symmetric  positive 
definite  solution  except  possibly  at  t  =  T  where  it  can  be 
semidefinite  if  Au  is.  Similarly,  with  the  additional  use  of 
[14],  it  also  follows  that  there  exists  a  unique  .V(<  solution 
to  (31)— (33)  upon  selection  of  the  unique  symmetric  nega¬ 
tive  definite  solution  of  (33)  and  subject  to  .Vu(to)  = 
Tii,  where  r»  is  an  arbitrary  n  1  X  nt  symmetric  negative 
semidefinite  matrix.  Here  -Vu(0  is  the  unique  symmetric 
negative  definite  solution  except  possibly  at  f  —  to  where 
it  can  be  semidefinite  if  Tn  is.  Let 


be  the  two  solutions  of  (30)  subject  to 


P*(T.p) 


•V'(to.M) 


I  Ah 

Uvm 

[ru 

L  ia ,  (io) 


nPvi(T)l 

P*(T)  J 

mA  u(to)  1 

-V„(to)J- 


(3o) 


(36) 


These  Riccati  solutions  exist  since  /„P"(7’,ii)  and 


(to, a)  are  symmetric  positive  semidefinite  matrices  for  a 
sufficiently  small.  Hence,  Pu  and  — iV,„  i  —  1,2  are 
symmetric  positive  semidefinite.  Then  there  exists  a*  >  0 
such  that  the  reduced  Riccati  solutions  P*  and  N*  approxi¬ 
mate  the  exact  Riccati  solutions  over  the  entire  interval; 
that  is, 

P„M  -  Ai(0  +00.)  .  , 

_  =*  1,2  (3<) 

(¥w«,m)  =  X„(t)  +  0(a) 

for  all  aE[0,a*l-  This  is  a  special  case  of  [6], [10] 

when  boundary  layers  are  “erased”  due  to  the  matching  of 
end  conditions  as  accomplished  by  (35)  and  (36). 

Matrices  P“  and  N“  are  now  used  to  introduce  the  trans¬ 
formation 


x  =  (  +  r 

\  =  P“(  t,M)/  +  ¥*■((. a)  r. 


(38) 

(39) 


The  nonsingularity  of  the  coefficient  matrix  of  the  trans¬ 
formation  for  f€[fo,r],  aE[0.a*]  is  now  shown  by  proving 
the  determinant  of  this  matrix  is  nonsingular.  Rewriting 
this  transformation  in  the  form[zi,Xi,Xi,X>]'  —  TR[fi,Xi, 
(i,tt ]',  the  determinant  of  TR  can  be  written  as 


(40) 


upon  application  of  the  expression  in  [2.  p.  46]  to  find  the 
determinant  of  a  block  partitioned  matrix.  The  first  de¬ 
terminant  is  nonzero  since  it  is  equal  to  the  determinant  of 
(Nu  —  P\\ ),  a  symmetric  negative  definite  matrix.  Semi- 
definiteriess  is  not  possible  since  P„,  i  -  1,2,  can  be  singular 
only  at  t  -  T  and  N„,  i  -  1,2  only  at  <  -  to.  Thus  from 
(37),  the  determinant  of  TR  becomes 
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det (Na  -  Pn)-det(iVj5  -  Pn)  +  0(a)  (41) 

for  a  sufficiently  small  which  thus  is  clearly  nonzero.  Sub¬ 
stitution  of  (3S)  and  (39)  into  (5)  “dichotomizes”  this  two 
point  boundary  value  problem  into  an  initial  value  prob¬ 
lem  starting  at  t  -  0. 

Ij  -  (A  -  SP*)(,  i(M  -  fib)  (42) 

and  an  initial  value  problem  in  reverse  time  starting  at 

t  -  T, 

I„i  -  04  -  SN>)t,  r(J\M)  -  rr0»)  (43) 

providing  there  exist  fiijt)  and  rr(a)  uniquely  expressible 
in  terms  of  x°  and  xT.  If  these  boundary  conditions  do 
exist,  (42)  and  (43)  can  be  analyzed  as  singularly  per¬ 
turbed  initial  value  problems.  Note  that  (42)  corresponds 
to  the  solution  of  a  free  endpoint  optimal  problem  in 
forward  time  while  (43)  corresponds  to  the  solution  of  a 
free  endpoint  optimal  problem  in  reverse  time.  Since  there 
are  no  boundary  layer  jumps  in  P*  and  N“,  the  right  hand 
sides  of  these  equations  are  continuous  in  a-  Furthermore, 
since  their  associated  boundary  layer  systems  (11)  and 
(13)  are  asymptotically  stable  uniformly  in  parameters  k 
and  T,  in  view  of  a  theorem  on  singular  perturbations  of 
initial  value  problems.5  there  exists  a*  >  0  such  that  for  all 
*G[*o.P]>  aG(0,a*]  the  solutions  of  (42)  and  (43)  are 
approximated  by 

«W-[i<!>+i!<r>]+0W  <44» 

",',-[w>  +  «m]  +  #w  <45) 

where  ((t),  i (t)  are  the  reduced  solutions  of  (42)  and  (43) 
formed  by  setting  a  =*  0  in  them  and  given  by 

J  -  (A  -  $F)t,  *,(«  -  trn  (46) 

q  -  (A  -  sm r,  h(T)  -  rir(0)  (47) 

and  JE (t),  <R(<r)  are  the  layer  terms  of  (42)  and  (43)  given 
by  (11),  (13)  with  initial  conditions  P°(0)  —  r./(0)  — 

rt(T),  respectively,  and,  as  will  be  shown,  expressible  in 
terms  of  x  variables  as  in  (12)  and  (14).  Furthermore,  it 
will  subsequently  be  shown  that 

i  -  }  +  r  (48) 

X  -  P*  ~(  4-  N*i.  (49) 

Thus  the  substitution  of  (44)  and  (4.'>)  into  transformation 
(38)  and  (39),  in  view  of  (37).  (48),  and  (49).  yields  the¬ 
orem  equations  (17)— (20).  Theorem  equation  (21)  then 

*  This  basic  theorem  is  well  documented  in  the  literature.  Readers 
unfamiliar  with  singular  perturbations  mav  consult  [61,(10],  and 
[111. 


follows  after  the  substitution  of  (19)  and  (20)  into  (6)  and 
the  use  of  identities  (9),  (15),  and  (16). 

It  will  now  be  proven  that  the  existence  of  the  reduced 
solution  £,  X  is  sufficient  for  proving  the  existence  of  a 
solution  x(t,n),  \{t,n)  for  aG(0,a*l-  This  is  equivalent  to 
showing  there  exist  fi(ji)  and  rr(a)  uniquely  expressible  in 
terms  of  x°,  xT.  Expressing  l{t,ix)  and  r (t,a),  using  funda¬ 
mental  matrices,  by 

-  *(t,to,»)fib),  r(f,M)  -  *(t,T,n)xT b)  (50) 

results  in  the  initial  value  singularly  perturbed  matrix 
differential  equations 

/„*  -  U  -  SP -)*,  .  HUM  «  I  (5D 

Ijr  -  (A  -  SN“)<fr,  *(T,7»  »  /.  (52) 

Since  the  associated  differential  equations  with  each 
column  of  $,  4'  are  identical  in  form  with  (42)  and  (43), 
respectively,  the  latter  of  which  were  stated  as  satisfying 
an  initial  value  singular  perturbation  theorem,  the  follow¬ 
ing  relation  holds: 

,y)  J 

=  [£  £]  +  [*/«  *,(*)]  +  0(m)  (i’3) 

for)  «  1,2,  and  <€[<o,T],  aE(0,a*]-  Here  -*  0  as 
t  -*■  *  and  -*•  0  as  a  -*•  —  ® .  Reduced  solutions  of 
(51),  (52)  are  [<f«  $a]  *  (0  0J  for  i  =  1,2.  Relating 
the  boundary  conditions  using  (3),  (4),  (38),  (50),  and  (53) 
yields 


|7i 

0 

if  11  (to) 

o' 

[VI  m  o 

h 

lf2l(fo) 

0 

+  0(a) 

[>&•>  i 

UrJ  *u  (T) 

0 

/l 

0 

lV(a)J- 

,*n(T) 

0 

0 

/*. 

(54) 

It  suffices  to  now  prove  that  the  coefficient  matrix  relat¬ 
ing  the  boundary  conditions  is  nonsingular.  Clearly  this  is 
true  if  the  coefficient  matrix  is  nonsingular  neglecting  0(a)- 
Its  determinant  is  the  determinant  of  [/  —  *u(Z')*u(fo)] 
and  also  results  from  the  transformation  relating  xi°.  x/ 
to  4°( 0),  rlr(0).  This  last  transformation  is  surely  non¬ 
singular  for  recall  equations  (48),  (49)  hold  as  a  conse¬ 
quence  of  assumption  1)  of  the  Theorem  which  assumes 
the  existence  of  the  reduced  i,  X  solution  and  the  fact  that 
transformation  (3S),  (39)  relating  x,  X  to  (.  r  is  non- 
singular  at  a  =*  0.  The  proof  is  now  complete  and  the 
initial  conditions  4°(0)  —  rir(0)  —  i:(T)  are  seen  to 
be  equivalent  to  (12),  (14),  respectively,  using  (4S),  re¬ 
duced  form  of  (.50),  and  (54)  with  0(a)  set  to  zero.  Note 
that  the  £(0)  and  (R(0)  boundary  conditions  given  by  (12) 
and  (14)  arc  directly  obtainable  from  (18)  with  0(a)  set 
to  zero.  Consider,  for  example,  x»  at  t  *»  to.  Upon  sub¬ 
stitution  of  (44),  (45)  into  (3S)  and  the  subsequent  use  of 
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(48)  yields 

£i°  =  it(k)  +  £(0)  +  (R((io  —  T)/n)  +  0(jt).  (55) 

Thus  (12)  is  satisfied  upon  noting  <R((f«  —  T)/p)  ap¬ 
proaches  zero  as  p  does.  A  similar  argument  holds  for 
finding  CR(0) .  In  fact,  £(0)  and  <R(0)  are  uniquely  deter¬ 
mined  by  this  method. 

Extension 

The  conditions  of  the  theorem  are  now  modified  to 
apply  to  the  terminal  cost  problem;  that  is,  the  problem  of 
optimum  control  of  (1)  with  the  performance  index 

J  =  §x7Mirx|_r  +  i  (x'Qx  +  u'Ru)  dt  (56) 

where  /„n*  is  symmetric  positive  semidefinite  for  all 
mG[0,m*]  and 

*  [mIV  Una}  (o7) 

In  this  problem,  x  is  free  at  t  —  T,  and  the  boundary  con¬ 
ditions  for  (5)  are 

x(1«,m)  -  x°,  X(7»  -  n'x(T,p).  (58) 

The  only  change  to  be  made  in  the  theorem  is  a  different 
initial  condition  for  (R (<r). 

Corollary  1:  Let  Hypotheses  1,  2,  and  assumptions 
2) — 4)  of  the  theorem  be  satisfied  except  for  (14)  which  is 
replaced  by 

<r(0)  -  [n*  -  .va(D]-l[X.(D  -  nu'i,(D  -  nais(T)j. 

(59) 

Then  the  theorem  applies  to  the  solution  x(l,p),  \(l,p)  of 
the  two  point  boundary  value  problem  (5)  subject  to  (58). 

Remarks:  Assumption  1)  of  the  theorem  is  more  strin¬ 
gent  than  required  here.  Hypotheses  1  ari  2  are  suffi¬ 
cient  to  guarantee  the  existence  and  uniqueness  of  the 
reduced  solution  x(t),  \(t)  as  shown  in  (4,  Lemma  3). 

It  readily  follows  upon  replacing  all  of  the  variables  by 
their  0(j»)  approximations  that  the  performance  index  /, 
given  by  (2)  for  the  fixed  endpoint  problem  and  by  (.56) 
for  the  free  endpoint  problem,  can  be  expressed  by  ./  =» 
J  4-  0(m).  Here  J  is  defined  as  J  where  all  variables  have 
been  replaced  by  their  reduced  solutions.  The  absence  of 
boundary  layer  terms  in  J  is  a  consequence  of  the  neg¬ 
ligible  area  associated  with  such  terms  under  the  per¬ 
formance  integral  for  small  p. 

The  proof  of  this  corollary  follows  the  proof  of  the 
theorem.  As  before,  (48)  and  (49)  can  be  shown  to  hold. 
This  used  in  conjunction  with  (37)— (39),  (44),  and  (45) 
yields  (17) -(20).  Using  fundamental  matrices,  it  follows 
as  in  the  theorem  that  the  coefficient  matrix  relating  the 
C(p),  xT(p)  to  the  x®  boundary  condition  is  nonsingular  for 
M  sufficiently  small.  Here  it  will  only  bo  shown  that  <R(0) 
as  defined  by  (59)  satisfies  (AS)  and  (39).  At  t  =  T,  they 


reduce  to 

Xi(T,m)  -  *i (T)  +  0(m)  (60) 

x4(T,m)  -  *t(T)  +  <Jt(0)  -(-  0 (m)  (61) 

h(T,p)  -  UT)  +  tf*(D«(l 0)  +  O0»)  (62) 

and  must  satisfy  (58).  The  X2  component  of  (58)  is 

Xi(7’,m)  m  nu'xi(T,p)  +  IIttXt(T,p).  (63) 


Thus  <R(0),  defined  by  (59),  satisfies  (60) -(63)  when  p 
equals  zero.  This  corollary  will  be  illustrated  in  the  next 
example  given. 

Closed-Loop  Control 

Up  to  this  point,  emphasis  has  been  on  open-  (at  least 
partially)  loop  controls.  Considered  now  are  approximate 
forms  of  the  optimal  feedback  control  of  the  free  endpoint 
problem  just  treated.  The  response  of  the  optimally  con¬ 
trolled  system  is  given  by 

Ij  -  (A  -  SK“)x,  x«o ,p)  -  x°  (64) 

where  K“  —  K*(t,p)  is  the  solution  of  (30)  with  the  end 
condition 

K“(T,p)  -  nr  (65) 

It  was  shown  in  [15],  that  if  the  optimal  control  is  re¬ 
placed  by  the  reduced  feedback  control 

u  «  -R-'B'K*x  (66) 

where  K*  is  the  solution  of  (31)-(33)  with  Rn(T,p)  »  IIu 
and  R~  is  the  unique  symmetric  positive  definite  solution 
of  (33),  the  plant  response  would  be  close  to  that  of  the 
optimal  one  of  the  open  interval  (fo,D  providing  p  was 
sufficiently  small.  It  was  further  shown  there  that  by 
appending  the  right  layer  correction  term  X(<r)  of  K*  to  K“ 
in  (66)  where  3Cu(<r)  *  0  and  3C« (<r) ,  JCj-(<r)  satisfy 

dXii 

~  -  -Xa[A,.(T)  -  Sti(T)Rn(T)\ 
d<r 

-  [An'(T)  -  Rn(T)Sn(T)  -  Ru(T)S~(T) ]Xa 
+  X\zSm(T)Xa  (67) 

dX.99 

-T5  -  -K n[An(T)  -  S*(T)Ru(T) } 

[Am  —  Sn(T) Rti(T)  ]' X-n  +  Xt>St:(T)X m  (68) 
and  initial  conditions 

xu(0)  =  nu  -  Rv.(T),  jcm(0)  -  n*.  -  K~m  (69) 

the  feedback  control 

u  =  —R-'B'tfC  +  X  (<r))x  (70) 

would  yield  a  plant  response  close  to  the  optimal  one  on 
the  partially  closed  interval  \to<T)  but  did  not  predict  the 
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behavior  of  the  plant  at  the  terminal  interval.  Here 

KM)  »  +  Ku(t)  +  0(m)  (71) 

for  all  t&[U>,T],  m€(0,m*1,  and  X1t(<r)  -►  0  as  a  -*■  — 
Equations  (67) -(69)  can  easily  be  derived  from  (30)  and 
(58)  by  replacing  K„(t,ti)  in  them  by  [£«(<)  +  JCM(<r)] 
for  t  -  1,2,  where  Xu(<r)  is  understood  to  be  zero,  and 
then  setting  m  equal  to  zero.  These  same  equations  are 
related  to  the  £i,  £,  boundary  layer  equations  in  (4],  [15] 
by  the  relation 

£,(r)  -  Ra (t)  +  JCfl(v),  i  -  1,2 

where  there  it  was  shown  the  £,  solutions  exist.  This  then 
implies  the  existence  of  the  Xa(<r)  solutions.  His  technique 
of  analyzing  plant  (1)  controlled  by  (70)  using  initial  value 
singular  perturbation  theory  could  not  be  applied  when 
including  the  terminal  time  since  the  right  hand  side  of  (1) 
was  not  continuous  at  m  »  0  as  required  by  such  theory. 
Use  of  the  dichotomy  transformation  avoids  this  problem, 
and  hence,  Corollary  2  proves  the  response  of  (1)  to  control 
(70)  is  close  to  that  using  the  optimal  feedback  control. 
The  smaller  m  is,  the  better  the  approximation.  Before 
proving  Corollary  2,  a  numerical  example  is  given  to 
illustrate  this. 

Example  3  uses  the  same  plant  used  in  example  2  but 
with  the  performance  index 

J  -  WiT)  +  I"  +  *»*  +  i«s)  dl  <73) 

Jo 

and  initial  conditions 

Xlo  .  4,  j2°  =»  3.  (74) 

See  Fig.  4  for  a  comparison  of  the  response  of  (25)  using 
the  optimal  feedback  control  with  the  response  using  the 


approximating  control  (70).  Although  not  shown,  the  two 
solutions  are  nearly  identical  for  a  “  0.01.  For  this  ex¬ 
ample,  the  approximating  feedback  gains  K,,  given  by  (71) 
with  0(a)  equal  to  zero  are 


KM 

Ku(t,p) 

Kn(t,n) 


9  -  4e*<1_1) 

3  +  2e5(‘-,) 

3  -  SeM~l)  5ei  s*  -  2e3’ 
3  +  2e5l'~l>  +  1  +  2e3' 


1  -I-  2e3'- 


(75) 

(76) 

(77) 


Fig.  4  also  illustrates  the  closeness  of  the  approximation 
for  x-i  using  Corollary  1. 

Corollary  2:  Let  Hypotheses  1  and  2  be  satisfied.  Then 
the  solution  of 


/„*  -  [A  -  S(K '  +  X(er))  Jar,  x((o,m)  -  (78) 


is  within  0(n)  of  the  optimal  solution  (64)  for  all  <£  [U>,T], 
m€(0>m*]-  Furthermore,  if  the  definitions  (11)  and  (12)  of 
£(r)  in  assumption  3)  of  the  theorem  are  retained  but  the 
definitions  (13)  and  (14)  of  <R(<r)  are  replaced  by 

CR(v)  -  [rfa(T)  -  Rn(T)  -  3Cu(<r)  ]~l 

X  [Xu'(<r)ii(T)  +  Xn(.<r)iz(T)  I  (79) 


and  assumptions  2)  and  4)  are  added,  then  the  theorem 
applies  to  the  solution  z(i,>»)  of  the  free  endpoint  problem 

(56) ,  (58). 

To  prove  this  corollary,  start  with 


r  -  {N“  -  K^-HK11  -  P*)t  (80) 

which  follows  from  (29),  (38),  and  (39).  The  optimal  solu¬ 
tion  to  the  free  endpoint  problem  (56),  (.58)  is  expressed  in 
x,  l  variables,  after  substitution  of  (SO)  into  (38)  and  re- 
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[ 


writing  the  (  differential  equation  (42),  by 

x  m  [I +  {N“-  -  P") }t  (81) 

Ij  «  (A  -  SP*)t,  ({t*,*)  -  (*(*).  (82) 

The  existence  of  the  optimal  solution,  and  hence  (81),  (82), 
is  guaranteed  to  exist  by  Hypotheses  1  and  2  for  all 
#»G(0,m*]-  The  proof  now  consists  of  showing  that  the 
solution  of  (81),  (82)  is  within  0(*)  of  the  solution  (81), 
(82)  where  K“  is  replaced  by  its  00*)  approximation 
[K“  +  X(<r)  ].  It  will  first  be  shown  that  the  K“  approxima¬ 
tion  changes  the  coefficient  matrix  in  (81)  by  only  an 
00*)  amount  and  second  that  it  changes  (°(*)  by  only  a 
similar  amount.  Knowing  this  and  upon  expanding  the 
coefficient  matrix  and  expanding  t  by  (44),  the  optimal  x 
solution  can  be  expressed  as  equal  to  the  approximate 
solution  plus  00*)- 

From  the  properties  previously  mentioned  pertaining  to 
singularly  perturbed  Riccati  systems,  it  is  known  that  the 
determinant  of  ( N “  —  K“)  is  nonsingular,  approaches  a 
nonzero  value  as  *  approaches  zero,  and  is  continuous  in  * 
for  mG(0.m*1-  Thus  the  K“  approximation  changes  the 
coefficient  matrix  in  (81)  by  only  an  00*)  amount.  Now 
choose  An  in  (35)  equal  to  Hu  so  that  P*  *  K“.  Next,  in 
(SO),  substitute  (37)  for  P*  and  N“,  (71)  for  K“,  and  (44) 
for  (.  This  yields 

r,  -  00*1  (83) 

r-j  *  [Am  —  —  JCjil~l[3Cn'fi  +  X-a(?j  +  £)]  +  0(jt). 

(84) 

From  (84),  it  is  seen  that  ri  at  t  »  to  is  00*) ;  hence,  (a(jt)  * 
j°  +  0(*)  using  (38)  which  shows  (”(*)  is  changed  only  by 
0(*i)  from  the  K*  approximation.  From  the  homogeneous 
r  system  (43),  it  follows  that  f(t)  =*  0  which  implies 
£(t)  —  t(t).  This  and  (38)  results  in  £(0)  as  given  by  (12). 
Also,  (79)  then  follows  from  (84)  upon  recognizing  £  -*  0 
as  r-»  ®.  Since  the  approximation  of  this  corollary  ’s 
within  0(**)  of  the  optimal  solution,  (R (<r)  defined  by  (79)  is 
within  0(**)  of  (R(<r)  defined  by  (13),  (59).  See  [12]  for  an 
example  illustrating  this.  Note  that  the  reduced  solution  £ 
can  easily  be  found  by  solving  only  an  initial  value 
problem  (. 

Conclusions 

The  control  engineer,  through  the  use  of  singular  per¬ 
turbation  theory,  has  been  provided  with  a  simple  means 
to  obtain  either  an  approximate  open-  or  closed-loop 
control  or  an  approximate  solution  to  his  original  system, 
where  the  closeness  of  the  approximation  is  determined  by 
the  smallness  of  **•  Requirements  for  implementation  of 
these  controls  and  interpretations  of  the  control  form  have 
also  been  presented.  The  basis  of  the  new  theory  developed 
has  been  using  a  dichotomy  transformation  to  separate  a 
two  point  boundary  value  problem  into  two  initial  value 
problems.  Throughout  this  paper,  the  theory  has  been 
presented  with  control-oriented  hypotheses  and  interpre¬ 


tations.  A  simple  design  procedure  and  corresponding 
example  have  provided  clarification  of  this  theory.  j 
Numerical  examples  have  illustrated  the  corollaries.  1 
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A  Class  of  Singularly  Perturbed,  Nonlinear, 
Fixed-Endpoint  Control  Problems1,2 

J.  H.  Chow1 

Communicated  by  L.  D.  Berkovitz 


Abstract.  Singular  perturbation  techniques  are  applied  to  a  class  of 
nonlinear,  fixed-endpoint  control  problems  to  decompose  the  full-order 
problem  into  three  lower-order  problems,  namely,  the  reduced  problem 
and  the  left  and  right  boundary-layer  problems.  The  boundary-layer 
problems  are  linear-quadratic  and,  contrary  to  previous  singular 
perturbation  works,  the  reduced  problem  has  a  simple  formulation.  The 
solutions  of  these  lower-order  problems  are  combined  to  yield  an 
approximate  solution  to  the  full  nonlinear  problem.  Based  on  the 
properties  of  the  lower-order  problems,  the  full  problem  is  shown  to 
possess  an  asymptotic  series  solution. 

Key  Words.  Optimal  control  problems,  singularly  perturbed 
nonlinear  systems,  time  scale  decomposition,  asymptotic  expansion, 
fixed-endpoint  problems. 


1.  Introduction 

High  dimensionality  and  nonlinearity  are  among  the  factors  complicat¬ 
ing  the  solution  of  optimal  control  problems.  For  systems  having  slow  and 
fast  parts,  the  full  optimal  control  problem  can  be  decomposed  into  separate 
lower-order  problems,  whose  solutions  are  combined  to  yield  a  near- 
optimal  control  for  the  full  problem.  For  linear-quadratic  problems,  this  was 
demonstrated  in  Ref.  1.  Here,  we  consider  the  fixed-endpoint  problem  of 
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minimizing  the  performance  index 

/  -  f  [  Vi(x,  t,n)+V'2  (x,  /,  n)z  +  z'  V3(x,  t,  n)z  +  u'R (x,  t,n)u]  dt 
Jo 

-f  [V(x,  z,  t,fi)+u'R(x,  t,(i)u]dt,  (1) 

Jo 

subject  to  the  class  of  nonlinear  systems 

dx/dt  -  a,(x,  t,  #*)+ Ai(x,  t,  m)z  +Bi(x,  t,  n)u,  (2-1) 

x(0,  (i)m  Xo(n),  x(T,n)-xr(ti),  (2-2) 

n(dz/dt )  -  a2(x,  i,  h)+A2(x,  t,  h)z+B2(x,  t,  #*)«,  (2-3) 

z(0,U.)-zo(n),  z(T,(j.)-zr(n),  (2-4) 

where  the  states  are  xeR"  and  z  e  Rm,  the  control  is  ueR\  p.  is  a  small 
parameter,  and  the  primes  denote  transposition.  We  assume  that  the 
matrices  V2  and  R  are  positive  definite  in  x  and  that  V  is  a  positive  definite 
function  of  x  and  z.  Furthermore,  we  assume  that  alt  A„  Bh  xo,  x-r,  *o»  *r.  V, 
R  have  asymptotic  power  series  expansions  as  fi  ■*  0  with  infinitely  differen¬ 
tiable  coefficients.  In  addition,  A2  is  assumed  to  be  nonsingular.  The 
Hamiltonian  for  problem  (1M2)  is 

H(x,  z,  u,  p,  q,  t,  (i)  -  V+u'Ru  +p'(at  +  Axz  +Biu)+q\a2+A2z  +B2u), 

(3) 

where  the  costate  variables  p  and  nq  satisfy  the  equations 


dp/ dt  -  -V,H(x,  z,  u,  p,q,t,n),  (4- 1 ) 

p(dq/dt) »  -VtH(x,  z,  u,  p,  q,  t,  p).  (4-2) 

The  control  which  solves 

dH/du  ■  2i?u  +B\p  +  B'2q  =0  (5) 

is  the  minimizing  control 

u^-kR-l(B\p  +  B'2q).  (6) 


The  substitution  of  the  control  (6)  into  systems  (2)  and  (4)  yields  a  nonlinear, 
two-point  boundary-valued  (TPBV)  problem 

dx/dt-a,+AiZ-kBiR~l(B\p+B2q)»gi(x,p,z,q,  t,  p),  (7-1) 

dp/dt  -  -VxH(x,  z,  -\R~\B\p+B'2q),  p,  q,t,p) 

■  g2(x,  p,  z,  q,  t,  p), 


(7-2) 
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li.(dz/dt)-a2+AiZ -\BrR~\B\p  +  p,  z,  q,  t,  p),  (7-3) 

M (dq/dt)  ~-V:-2V3z  -A\p-A‘2q  ■  g«(x,  p,  z,  q,t ,p),  (7-4) 

where  the  boundary  conditions  are 

x(0,m)-xo(m).  x(r.M)-Xr(M).  (7-5) 

z(0,  p)-z0(p),  z(T,p)~  zt(p).  (7-6) 

Optimal  control  problems  of  the  type  (1M2)  with  free  endpoints  are 
treated  in  Refs.  2-4,  while  more  general  free-endpoint  problems  are 
considered  in  Refs.  5-7.  The  fixed-endpoint  problem  has  been  treated  in 
Ref.  8,  where  the  performance  index  (1)  is  in  quadratic  form  and  the  system 
(2)  is  linear.  For  the  nonlinear  fixed-endpoint  problem,  our  approach  is  to 
decompose  the  full  problem  (1)— (2)  into  three  separate  lower-order  prob¬ 
lems,  an  n  -dimensional,  nonlinear  reduced  problem  and  two  m -dimensional, 
linear-quadratic  boundary-layer  problems.  Thus,  the  technique  in  Ref.  8  for 
linear-quadratic  problems  is  now  extended  to  nonlinear  problems.  A 
further  result  is  that  our  formulation  of  the  reduced  problem  is  particularly 
simple.  Then,  similarly  to  the  results  of  Refs.  2, 3, 4, 7,  a  solution  x,  z,  p,  q,  u 
to  the  full  TPBV  problem  (7)  is  shown  to  possess  an  asymptotic  series 
expansion  in  p  and  is  approximated  to  O(p)  by  combining  the  solutions  of 
the  reduced  problem  and  the  boundary-layer  problems.  For  practical 
implementation,  we  propose  a  partially  closed-loop  control  to  achieve 
stability  of  the  fast  variable  z. 

The  organization  of  the  paper  is  as  follows.  First,  we  formulate  the 
lower-order  problems  in  Section  2  and  propose  an  0(p )  approximate  design 
(Theorem  3.1).  For  readers  who  are  interested  only  in  applying  the  theory,  it 
is  sufficient  to  read  Sections  2  and  3  and  the  example  in  Section  4  illustrating 
the  design  procedure.  The  series  expansions  of  x,  z,  p,  q,  u  are  dealt  with  in 
Section  6  and  the  Appendix. 


2.  Lower-Order  Problems 

Due  to  the  presence  of  p,  the  system  (2)  possesses  a  two-time-scale 
property,  that  is,  the  variable  x  varies  slowly,  while  the  variable  z  has  a 
rapidly  varying  part.  Letting  p  *  0  in  system  (2),  which  is  equivalent  to 
neglecting  the  fast  part  in  z,  we  obtain 

dx/dt~Si  +  A\z+§\u,  x(0)-xo(0),  x(D»xr(0),  (8-1) 

0  ~a2  +  Ai2  +  B2u.  (8-2) 
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Here  and  in  the  following,  an  overbar  indicates  that  n  *  0.  Assuming  that  A2 
is  nonsingular,  the  slow  part  I  of  r  is  solved  from  Eq.  (8-2)  as 

f.-Al'to+Sjfi).  (9) 

Eliminating  f  from  Eq.  (8-1)  and  the  performance  index  (1)  evaluated  at 
M  *  0,  we  define  the  reduced  problem  as  follows. 

Reduced  Problem.  The  reduced  problem  is  to  minimize  the  per¬ 
formance  index 

/-£  [U(x,  t)+2L'2(x,  t)u  +  a'Lt(x,  t)u)  dt,  (10) 

subject  to 

dx/dt-d(i,t)+B(£,t)u,  i(0)-xo(0),  £(T)-xt(0),  (11) 

where 

Lt  -  9X  -  V'iAVii  +  diA'r'1  VyAVdi, 


+  (12) 

d  m  d\  —  AiAj  ld2, 

B  ■  S\  —*  A 1A2  '5j. 

The  Hamiltonian  of  the  reduced  problem  is 

fid,  p,  a,  t )  -  Li + 2L\a + a' Ltd + p\d +Su),  ( 13) 

where  the  costate  variable  p  satisfies 

dpidt--VtR(i,p,u,t).  (14) 

The  control  which  solves 

dH/du  =  2L2+2LiH+B'p*0  (15) 

is  the  minimizing  control 

u  *  — ii-3 1  (2Lj  +  S'p).  (16) 

Substitution  of  the  control  (16)  into  the  systems  (11)  and  (14)  results  in  the 
reduced  TPBV  problem 

dx/dt  -  d  -  bl;'l2  -  \6l;1S'p  «/,(*  p,  t),  m  -  xo(0), 

f(D-xr(0).  (17-1) 

dp/dt--V,i)(£.p.  -kLV(2L2  +  B'p),l)-f2(x,p,t).  (17-2) 

The  following  hypothesis  is  crucial. 
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Hypothesis  (HI).  The  reduced  TPBV  problem  (17)  has  a  unique 
solution  x*(r),  p*(t),  u*(t)  for  ail  t  e  [0,  T\ 

Linearizing  the  system  (17)  along  i*.  p*,  we  obtain  the  variational 
equation  as  follows: 

m-lci  -'SO  ™ 

where 

The  system  (18)  is  assumed  to  satisfy  the  following  hypothesis. 

Hypothesis  (H2).  C3  is  positive  semidefinite  along  x*>  p* . 
Hypothesis  (H2)  rules  out  the  occurrence  of  conjugate  points  (Ref.  9) 
and  guarantees  that  x*,  p*  yield  a  local  minimum.  This  hypothesis  is  also 
crucial  for  finding  higher-order  terms  in  the  asymptotic  series  expansions  for 
the  solution  of  the  TPBV  problem  (6H7). 

Since  2*  of  Eq.  (9)  in  general  does  not  satisfy  the  end  conditions  (2-2), 
we  assume  that  the  variable  z  contains  an  initial  (left)  boundary  layer  A  (r) 
and  an  end  (right)  boundary  layer  p(<r)  such  that 

z(rW(f)  +  A(r)  +  p(a),  (19) 


where 

r  » t/p  and  <r  »  {t  -  T)p 

are  the  stretched  time  scales.  Substituting  Eq.  (19)  into  the  system  (2-2)  and 
equating  the  layer  terms,  we  obtain  the  boundary  layer  systems  as 

dA(r)/dT-A2(0)A(r)  +  B2(0)uJr),  A  (0)  ■»  Zo(0)  —  2*(0),  (20) 

dp(<r)/d<r-A2(T)p(<r)  +  Bl(T)ut(cr),  p(0)-Zr(0)-f*(7*),  (21) 

where  u  is  also  decomposed  into 

M(r)-fi*(r)  +  u*(r)  +  H,(<r).  (22) 

Substituting  Eqs.  (19)  and  (22)  into  the  performance  index  (1)  and  retaining 
only  the  quadratic  terms  in  A,  p,  uK,  u„  we  define  the  boundary  layer 
problems  as  follows. 

Boundary-Layer  Problems.  The  left  boundary-layer  problem 
(LBLP)  is  to  minimize 

[A' Vj(0)A  +  uii?(0)uA]  dr,  (23) 
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subject  to  the  system  (20).  The  right  boundary-layer  problem  (RBLP)  is  to 
minimize 

/,«  f  [p'  Vj(Dft  +  utfmu,]  dp,  (24) 

J— <30 

subject  to  the  system  (21). 

We  now  make  the  following  hypothesis. 

Hypothesis  (H3).  For  all  t  e  [0,  T]  and  along  the  trajectory  x*. 

rank[B2,  A2fl2, ....  A"~l.B2]  *  m, 
rank[J?i,  Ajtfi, ....  Ai""ltf  2]  «  m, 

where  satisfies  H2H2  ■  Vj. 

Hypothesis  (H3)  is  equivalent  to  assuming  that  the  pair  [A2(f),  -82(f)]  is 
completely  controllable  and  the  pair  [A2(f),  H2(/)]  is  completely  observable 
for  all  /  €  [0,  T\  Under  Hypothesis  (H3),  the  solutions  to  LBLP  and  RBLP 
exist  and  are  given  by 

Mr)  -  -^-‘(0)5i(0)ii:A(0)A(T)t  (25) 

up(<r)  -  -R-\T)§'2(T)K,[T)p[<r),  (26) 

where  ATa(0)  is  the  positive-definite  solution  and  K0(T)  is  the  negative- 
definite  solution  of  the  Riccati  equation 


KA2+A2K-KB2&'iB,2K+Vi~Q  (27) 

a  f  *  0  and  t  -  T,  respectively.  Due  to  the  presence  of  boundary  layer  terms 
in  u,  Eqs.  (6)  and  (22)  show  that  there  are  also  boundary  layers  in  the  costate 
variable  q,  which  is  explored  in  the  following  section. 


3.  Main  Theorem 

The  decomposition  of  the  full  problem  ( 1  M2)  into  the  reduced  problem 
and  two  boundary-layer  problems  is  justified  in  the  following  theorem. 

Theorem  3.1.  If  Hypotheses  (H1MH3)  hold,  then  there  exists  a 
M*>0  such  that,  for  all  u  s  (0,  p.*},  an  asymptotic  series  solution  x*,  z*,p *, 
q*,  u*  to  the  TPBV  problem  (6)-(7)  exists  and  is  approximated  to  O(p)  by 
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the  solutions  of  the  reduced  problem  and  the  boundary-layer  problems  as 


follows: 

x*U,p)«i*(f)  +  0(p),  (28-1) 

z*(l,  p)  -  f  *(t) + A  (r) +p(*r)+ O(m).  (28-2) 

p*(f,pW*(r)+0(p),  (28-3) 

q*(t,  p)  -  -A'i\  V2  +  2?,i*  +  A',/>*)  +  2*a(0)A(t) 

+2tf,(r)p(<r)  +  0(p),  (28-4) 

u*(r,  p)-  «*(/)+■  uA(r)  +  «,(£r)  +  0(p).  (28-5) 


The  meaning  of  this  theorem  is  that  we  can  obtain  an  O(p)  approximate 
solution  to  the  full  TPBV  problem  (7)  by  solving  for  the  reduced  problem, 
the  LBLP,  and  the  RBLP.  The  reduced  problem  is  of  lower  order  and  does 
not  involve  the  small  parameter  p.  Thus,  we  can  use  large  stepsizes  in  the 
numerical  computation  of  the  reduced  problem.  The  LBLP  and  the  RBLP 
are  linear-quadratic  problems,  and  their  computation  requires  a  small 
fraction  of  the  time  required  to  compute  nonlinear  problems  of  the  same 
dimension.  Thus,  solving  for  the  lower-dimension  problems  results  in 
considerable  savings  of  computation  time. 

In  the  actual  implementation  of  the  control  (22)  for  the  physical  system 
(2),  undesirable  behavior  will  occur  if  A  j  is  unstable.  Since  the  control  (22)  is 
open  loop,  it  does  not  affect  the  stability  of  the  system  (2).  Hence,  if  A2  is 
unstable,  the  higher-order  p  terms  in  the  approximation  (28)  which  are  not 
compensated  will  grow  as  0(exp(  1  /p )).  Furthermore,  the  error  increases  as 
p  decreases.  An  example  illustrating  this  behavior  in  linear,  time-varying 
systems  is  given  in  Ref.  8.  This  problem  can  be  avoided  by  using  a  partially 
closed-loop  control 

u  »M(x(f),  f)r  +  (29) 

such  that  Ai  +  BiM  is  stable  along  the  trajectory  x*.  Hypothesis  (H3) 
guarantees  that  such  an  M  exists  and  can  be  computed  as 

\f--fi-'6'2K(t),  (30) 

where  K(t)  is  the  positive-definite  solution  to  Eq.  (27)  for  t  e  [0,  7"].  Then, 
the  open-loop  control  v  is  computed  as 


v  ■  u  -Mz. 


(31) 


JOTA:  VOL  29,  NO.  2.  OCTOBER  1979 


4.  Example 


We  consider  the  optimal  control  of  the  system 

x»xz,  x(0)»l/>/2,  x(l)-0.5, 

Mi  «-z+m.  z(0)  ■  0,  z(l)«0, 

with  respect  to  the  performance  function 

/«f  (x*+kz2+lu2)dt. 

Jo 

The  Hamiltonian  for  problem  (32H33)  is 

H  ■x4  +  iz2  +  iuJ+p(xz)  +  g(-z  +  u), 
and  the  minimizing  control  is  - 


as 


dH/du»u+q*  0. 


Thus,  the  TPBV  problem  is 

x»xz. 


(32) 


(33) 

(34) 

(35) 


p  ■  -dH/dx  ”  -4 xJ  -pz, 

U4  *  —dH/dz  -  -px  -z+q. 

We  now  apply  the  decomposition  procedure  to  obtain  O(m)  approximations 
of  x,  z,  p,  q,  u. 

The  reduced  problem  corresponding  to  the  full  problem  (32M33)  is  to 
optimally  control  the  reduced  system 

i-ifi,  itO) » 1/V2,  f(l)«0.5,  (37) 


with  respect  to 

7-f  U4+sJ)dr. 

The  Hamiltonian  for  this  reduced  problem  is 

h  -  i* + a2 + pm, 
and  the  reduced  control  u  satisfies 

dff/di J  »  2u  +  pi  »  0, 


(38) 

(39) 


(40) 
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that  is. 


a  -  -pn  2. 


The  reduced  TPBV  problem  becomes 

i—**P/  2,  *(0)-l/V2.  i(l) -0.5, 

p  -  -dH/dx  -  -4 i3 -pii  -  -4iJ +i?2/2. 


The  unique  solution  to  system  (42)  is  found  analytically  to  be 


i*(f)-l/'/[2(f  +  l)], 
p*(t)  -  2i*(r)  *  v'[2/(r  + 1)], 
u*(t) «  -  -l/[2(r  + 1)], 

!*({)• 

Linearization  of  system  (42)  along  i*.  p*  reveals  that 

C,-5/(r  +  l); 


hence.  Hypothesis  (H2)  is  satisfied. 

The  LBLP  is  to  optimally  control 

dA/dr»-A+u*f  A(0)  —  0  — (-  1/2)  —  1/2, 

with  respect  to 

A -if  (A  2  +  u})dr. 

Jo 

The  optimal  control  is 

m*(,t)--M(t)--(v/2-1)A  (r), 


(41) 


(42) 


(43) 


(44) 

(45) 

(46) 


where  kA  is  the  positive-definite  solution  to  the  Riccati  equation 

0«2*+*2-l.  (47) 

Thus,  the  optimally  controlled  LBL  system  is 

dA/dr  — — >/2A,  (48) 


yielding 

A(T)»A(0)exp(-v/2r),  0«r<  oo.  (49) 

Similarly,  the  RBLP  is  to  optimally  control 

dp/dtr--p  +  H„  p(0)  -0  — (-  1/4) -  1/4,  (r-«-  1)/m,  (50) 


JOTA:  VOL.  29,  NO.  2,  OCTOBER  1979 


with  respect  to 

/•-if  (j>2  +  ul)d<r.  (51) 

The  optimal  control  is 

Up  m  —k,p(r) » (1  +n/2)p(t),  (52) 

where  ke  is  the  negative-definite  solution  to  the  Riccati  equation  (47), 
resulting  in  the  feedback  system 

dp/dtr  » -J2p,  (53) 

such  that 

p(o-)»p(0)exp(V2a),  -oo<o-s0.  (54) 

Thus,  an  0(p )  approximation  to  the  solution  of  the  full-order  problem 
(36)  is 

i(r)-l/V[2(r+l)], 

f  (/)  -  - 1  /[2(f  + 1 )] + [exp(  -  V2  f/M )]/2 + (expfV2  (r-l)/M])/4, 
p(t)-V[2/(/  +  l)], 

4(r)  -  l/[2(r  + 1)] + (V2  -  l)[exp(-  Jlt/n  )]/2 
-  ( 1  +  V2)(exp[V2(r  - 1  )/n  ])/4, 
u(r)  »-<?(*). 


(55) 
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For  n  the  trajectories  are  shown  as  dashed  lines  in  Figs.  1-5.  The 
Newton-Raphson  algorithm  in  Ref.  10  is  modified  for  fixed-endpoint 
problems  by  using  the  dichotomy  transformation  in  Ref.  1 1  and  is  used  to 
compute  an  optimal  solution  of  the  TPBV  problem  (36).  Using  the  approx¬ 
imate  trajectory  (55)  as  the  initial  guess,  the  computation  converges  in  four 
iterations,  and  the  optimal  trajectories  x\  z *,  p*,  q*,  u *  are  shown  as  solid 
lines  in  Figs.  1-5.  Note  the  presence  of  boundary  layers  in  z*,  q*.  u*.  The 
closeness  of  the  trajectory  (55)  to  the  optimal  trajectory  is  obvious. 


5.  Asymptotic  Expansions 

We  now  proceed  to  obtain  asymptotic  series  expansions  of  x,  z,  p,  q,  u  in 
Then,  Theorem  3 . 1  follows  from  the  fact  that  approximation  (28)  consists 
of  the  leading  terms  in  the  expansions. 

Lemma  5.1.  Under  Hypotheses  (H1MH3),  the  TPBV  problem  (7) 
possesses  a  solution  of  the  form 

x(r,  n)  =  XN(t,  n)+fimi(r,  a)+(tn?(<r,  n)+nNxs(t,  n), 

p(t,  ti)=*P‘v(t,ii.)  +  nm%(T,n)  +  nni{cr,  n)  +  nsp"(t,n), 
z(,t,  fx)  -  r‘v(f,  n)  +  m3(T,  n)  +  ni(<r,  n)  +  n*zN(t,  p), 
q(t,  p.)  m  QN(t,  n)  +  m?(r,(i)  +  n?(<r,  n)  +  p.Nqs{t,  n). 


(56) 
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Fig.  3.  Plot*  of  p*  and  fi. 


for  all  N  a  0,  where 

N 

N 

Xs  -  I  n%(t,  n). 

PN~  I 

i-0 

i-0 

(57) 

s 

Zs  =  l  n‘Z,(t,tx), 

q"®  I  m'QiUm). 

i-0 

i-0 

constitute  the  outer  expansion, 

-V-l 

mk  ®  I  n‘mu(T,n),  k®  1,2, 

m*3  I  ii'mki(T,  n). 

k  =  3,  4, 

i-0 

i-0 

(58) 

I  fx‘nu(<r,  **)>  k  ®  1,  2, 

i-0 

V 

nk  m  2.  fi'rtuia,  fi), 

i-0 

k®  3,4, 

are  the  left  and  the  right  boundary-layer  expansions,  respectively,  and 
xs,ps,  zN,  qs  are  O(m)  uniformly  in  the  interval  t  e  [0,  T] for/*  sufficiently 
small. 


Proof.  Outer  Expansion.  The  outer  expansion  is  obtained  by  substi¬ 
tuting  (Xs,  Ps,  Zs,  0s)  into  the  TPBV  problem  (7)  and  equating  the 
coefficients  of  like  power  of  m',  0  s  i  s  N.  At  i  ®  0,  (Xo,  Po,  Zo,  Qo)  is  the 
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solution  to 

dXo/dt-dt+AiZo-lSiPo-lSQo.  Xo(0) m Xo(0),  Xo(D-xr(0), 

(59-1) 

dPo/dt  -  -VZH(X o.  Z0.  -iR~l{B\Po+B'2Qo),  Po,  Qo.  t ,  0),  (59-2) 

0*02  +  A2Zo  —  ^S'Po  ~  i£2Qo,  (59-3) 

0  -  -  -  2  VjZo -  A'.Po  "  AiOo,  (59-4) 

where  dt,  &2,  At,  A2.  Bu  B2, 

S\  * Bi8~lB'\,  $2~B2R~lB2, 

V,.  V2,  V,  are  evaluated  at  (*„,  Po,  Z0,  Q0)  and  m  -0.  In  general,  for 
1  sisN,  (X„  Pi,  Zi,  Ot)  is  the  solution  to 

dXl/dt-glAt)Xi-kS\(t)P<+Ai(t)Z,-{S{t)Ql+au(t),  (60-1) 
dPJdt  -  g2x(t)Xi+g2f(t)Pi  +g2,(t)Zi  +g2<(t)Qi+a2M,  (60-2) 
0  -  g3l(r)Ai -l$V)P,+Ai(t)Z,-tf2(t)Q,+an(t),  (60-3) 

0  *  g4  AOX,  -  A',  (r)i».  -  2  Vi(t)Z,  ~A'2(t)Q,  +  04.(0.  (60-4) 

where  the  matrix  coefficients  of  {X„  Pit  Z„  <?,)  are  evaluated  at 
(Zo,  Po,  Z0,  Qo)  and  m  -  0,  and  crkj(0,  *  -  1, 2,  3, 4,  are  known  functions  of 
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(Xn  P„  Z„  Q,)  for  r  s  i  - 1 .  From  Hypothesis  (H3),  it  follows  that 

r  Aid) 

L-2Vj(r) 


(61) 


is  nonsingular  (Ref.  8).  Hence,  Z„  O,  can  be  solved  uniquely  from  Eqs. 
(60-3)  and  (60-4)  and  eliminated  from  the  equations  for  dXJ  dt,  dPJdt.  For 
i »  0,  it  is  shown  in  the  Appendix  that  the  elimination  of  Z0,  Oo  from  Eqs. 
(59-1)  and  (59-2)  yields  the  reduced  TPBV  problem  (17),  with  Xn,  Pa 
replacing  i,  p.  Hence,  from  Hypothesis  (HI),  the  uniqueness  of  solution 
gives 

*o-x*,  fW*.  (62) 

and  Zo,  Qo  are  given  in  Eq.  (92)  of  the  Appendix. 

It  then  follows  immediately  that,  for  1  s  i  s  N,  the  elimination  of  Z,  Q, 
from  Eqs.  (60-1)  and  (60-2)  yields 

dXJdt  -  C,(t)X i  -  Ci(f)Fj+au(t), 

(63) 

dPJdt  -  -C,( t)X<  -  C\  U)Pi+du(t), 

where  Cu  Ci,  Cj  are  given  in  Eq.  (18).  The  boundary  conditions  for  the 
system  (63)  are 

X,(0 )-«'  and  Xm-b1, 


where  a b '  will  be  specified  later.  Since  Ci  is  positive  semidefinite  and  L)  is 
positive  definite,  the  solution  Kp(t)  to 


K  -  -KCx  -  C\K  +  KCiK  -  Ci, 


1 

I 

I 

I 


(64) 
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with  end  condition 


K(T)-vu 


(65) 


is  positive  definite  in  f  s  [0,  T)  for  any  irt  positive  semidefinite,  and  the 
solution  KM)  to  Eq.  (64),  with  end  condition 

*(0)-rr2,  (66) 

is  negative  definite  in  t  s(0,  T]  for  any  m  negative  semidefinite  (Ref.  11). 
Introducing  the  dichotomy  transformation  (Ref.  11) 


X<  *  y(  +  w„  P,  -  K,y,  +  K„w„  (67) 

and  substituting  into  Eq.  (63),  we  obtain  the  equations  for  yh  w,  as  follows: 


hence. 


dyj  dr  ”  (Ci  —  C2Xp)yf  +  ayi ; 

(68-1) 

dw,/dt  ■  (C,  -C2Kn)w,+aw,-, 

(68-2) 

(69) 

and  /  is  the  n  x  n  identity  matrix.  Let  <t>,,  d>2  be  the  state  transition  matrices 
of  the  system  (68-1)  and  (68-2),  respectively.  Then,  the  solution  to  Eq.  (68) 
is 


y,(r)  =« <t»x(r,  0)y,(0)+  [  <t>i(r,  s)ayi(s)  ds, 

Jo 

wi(r)  -  <t>2(f,  T)w,(T)  + J  <l>2(r,  s)aw,(s)  ds. 


(70) 


To  determine  y,(0),  w,(r),  we  evaluate  the  expression  (70)  at  r  =  0  and 
i  *  T;  and,  due  to  Hypotheses  (HI)  and  (H2),  the  end  conditions  are 
determined  uniquely  (Ref.  8)  as 

r*(0n  f  I  <t>2(0,T)l-'ral-$<t>2(0,s)awi(s)ds'l 

u.mj  Umt.o)  /  J  L6‘-joT4>,(r,j)«VI(j)dsJ' 

Thus,  given  a'b\  the  unique  solutions  y„  w,  to  Eq.  (68),  and  hence  the 
unique  solutions  X»  P,  to  Eq.  (63),  can  be  computed. 


Proof.  Boundary- Layer  Expansions.  Since  Z(0,  m)  does  not  in 
general  satisfy  the  initial  condition  Zo(m).  it  is  necessary  to  account  for  this 
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boundary  layer  by  m?(r,  n),  k  “  1, 2, 3, 4,  which  satisfy  at  t »  0  the  equa¬ 
tions 

[dm? /dr]  -  [dx/d/  -  dXN/dt],.„  [dm? /dr]  -  [dp/dt  -  dPN/dt\,.„ 

(72) 

[dm?/ dr]  -  [dz/dt-  dzN/dr],.^  [dm? /dr]  -  [dq/dt  -  dOw/df],-^ 

to  Hence,  we  have 

dm?/ dr  »  gk(m?,  m?,  m?,  m?,  r,  n) 

•  gk(XN^r)+nm?(r),PN^r)+nm?(r), 

ZN(nr)  +  m?(r),  QN(nr)  +  m?(r),  /it,  h) 

~gk(XN(nr),  P* (/zr),  ZN(fir),  QN(nr),  fxr,  n),  k  *  1,  2, 3,  4. 

(73) 

Substituting  Eq.  (72)  into  Eq.  (73)  and  equating  the  coefficients  of  like 
power  of  p. 0  s  /  as  N,  we  obtain  a  system  of  equations  for  the  left  boundary 
layer.  At  i  ■  0,  the  zeroth-order  terms  of  m?  satisfy 

dmxo/dr  »  A i(0)mjo ~iS(0)m*o. 

dm10/dr  »  g2(Xo(0),  /MO),  Zo(0)  +  m30(r),  Oo(0)  +  m«0(r),  0,  0) 

-  g2(*o(0),  f»o(0),  Zo(0).  C?o(0).  0. 0),  (74) 

dm30/dr  »  A2(0)m3O  -  2S2(0)m«o, 

dm  to/  dr  »  -2  V3(0)m3O  -  A2(0)m«0, 
where  the  initial  condition  for  m30  is 

m3o(0) m  zo(0)  —  Zo(0). 

Furthermore,  m,o(r)  tends  to  zero  as  r  tends  to  infinity.  Letting 

mtoM  m  2Kk(0)m3o(r),  (75) 

where  /if*  (0)  is  the  positive-definite  solution  of  Eq.  (27)  at  t «  0,  we  obtain 

dm3a/ dr  *[Ai~ SiK^tmomyo,  m3o(0)»zo(0)  — Zo(0).  (76) 

Thus,  Ai-SiK*  is  stable;  and  m3o(r),  and  hence  m4o(r),  decay  exponen¬ 
tially  to  zero.  Now,  comparing  the  system  (76)  to  the  system  (20)  controlled 
by  uK,  we  obtain 


"»jo(r)-A(r). 


(77) 
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Furthermore,  m i0(r),  m20(r)  are  given  by 

T  (78) 

m20(r)  ■  [dm2o(i)/dr]  dr. 

Then,  the  initial  condition  a'  of  X\  in  the  system  (63)  is  given  by 

a 1  -  vV,  (0)  -  {(d/d*  )*o(m )]„  -o  -  « io(0)  ' 

-  [(d/dM)*o(M)]»  -o -[(A,-  $K„  )(A2  -  S2KA  )■'],. o(^o(0)  -  Zo(0)).  (79) 


In  general  mu(r)  satisfies  the  equations 

dmu/dr  »  Ai(0)»i3(  -|^(0)m4i  +Mii(r),  (80-1) 

dmijdr  -  gi,(X0(0),  Pa( 0),  Zo(0)  +  mia(r),  Qo(0) 

+  ^40 (t),  0, 0)mjj  +g2t(X o(0),  Po(0),  Zo(0) 

+  mjo(r),  Oo(0)  +  m«>(r),  0. 0)m4i  +AT2,(t),  (80-2) 

dm-iJdr  »  A2(0)mj|  -J5j(0)m4i  +  A/ji(r),  (80-3) 

dm+t/dr  -  -2  V3(0)mJ(  -  A2(0)m4.  +A/4<(f),  (80-4) 

where  the  exponentially  decaying  terms  Mki(r),  k  -  1, 2, 3, 4,  are  known 
successively.  We  solve  for  the  systems  (80-3)  and  (80-4)  by  letting 

m«l(T)»2X*(0)mjf(r)  +  /3i(r)f  (81) 

where  /?,  satisfies  the  linear  system 

d/3,/dr-  -[A2-S2tfA];.o0,  -2/CA(0)Af,f(r)  +  A/4,(r).  (82) 

In  Ref.  4.  it  is  shown  that  there  exists  a  unique  exponentially  decaying 
solution  to  system  (82).  Then,  m3i(r)  is  given  by 

dm}, /dr  » [A2-S2/Ca](-o'Wji  _i$t(O)0i(r)  +  Mji(r),  (83) 

with  initial  condition 

m },  (0)  -  [a‘z0(M  )/dn  '  ]„  -o  -  Z(  (0). 


Hence,  the  solutions  mkj(r),  k  »  1,  2,  3, 4,  to  the  system  (80)  are  exponen¬ 
tially  decaying.  The  initial  condition  a'  of  X,  in  system  (63)  is  given  by 

fl'-X-((0)»[jW)/«l*l.o-m,.(0).  (84) 

In  a  similar  manner,  the  right  boundary  layer  correction  terms  n  k(<r,  n ) 
satisfy  the  equations 
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dnjda  -  ®k(ni,  n2,  n4,  <r,  m) 

■  gk(X(( ur) + (in i(<r),  P{(ur) + (in2(a),  Z ( jia ) + nj(<r), 

0(/«r)+fl4(<r),  (ur,(i) 

-  gk(X((i<r),  P(pur),  Z (tta),  Q{(ur),  iia,  (i),  fc  -  1.2, 3, 4. 

We  shall  not  give  the  procedure  of  solving  nki,  which  is  exactly  the  same  as 
that  of  solving  for  mu,  except  that  we  are  now  solving  in  inverse  time,  that  is, 
from  <r  -  0  to  <r  -  -oo.  We  only  examine  the  equations  for  /»*>,  /140,  which 
are 

dn-io/da  ■  A 2( T)n jo  — 40*  njo(T) m  Zr(0)—Zo(T), 

(86) 

dn*o/ da  m  —2  V}(T)ny}— A.2(T)n4o. 

Let 

nio(<r) m  2K0(T)nio(a),  (87) 

where  Kt(T)  is  the  negative-definite  solution  to  Eq.  (27)  at  t  *  T.  Since 
-  [A 2  -  §2K,],~t  is  stable, 

dntol  da  m[A2— (88) 

is  stable  in  negative  time  and  decays  to  zero  as  a  —  -oo.  Comparing  the 
system  (88)  to  the  system  (21)  controlled  by  u„  we  obtain 

«3o(<r)-p(<r).  (89) 

The  end  conditions  for  n2i(T),  Xj(T)  are 

nJI(T)-[dizT((i)/d(i%.o-Zl(T), 

(90) 

Xi(T)~[d,xT((i)/dn‘)».o-nu(T)-bi. 

It  remains  to  be  shown  that  xN,  pN,  zN,  qN  are  0((i).  However,  this 
asymptotic  property  has  been  shown  in  detail  in  Ref.  3  for  the  free-endpoint 
problem,  and  can  be  translated  for  the  fixed-endpoint  problem  without 
major  changes.  Thus,  we  shall  omit  this  part  of  the  proof. 

From  Lemma  5 . 1 ,  we  obtain  the  approximation  (28)  of  Theorem  3 . 1  by 
observing  that  Eqs.  (28-1)  and  (28-3)  follow  from  Eq.  (62);  Eq.  (28-2) 
follows  from  Eqs.  (92),  (77),  (89);  Eq.  (28-4)  follows  from  Eqs.  (92),  (75), 
(87);  and  finally  Eq.  (28-5)  follows  from  Eqs.  (91)  and  (6). 


6.  Conclusions 

A  singularly  perturbed,  nonlinear,  fixed-endpoint  problem  is  de¬ 
composed  into  three  lower-order  problems,  namely,  the  reduced  problem 
and  the  left  and  the  right  boundary-layer  problems.  Two  special  features  are 
that  the  reduced  problem  does  not  involve  the  singular  perturbation 
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parameter  and  the  boundary-layer  problems  are  linear-quadratic.  Combin¬ 
ing  the  solutions  to  these  lower-order  problems,  we  obtain  an  O(n)  approx¬ 
imation  (28)  of  a  solution  to  the  full  TPBV  problem  corresponding  to 
problem  (1H2).  Based  on  the  properties  of  the  lower-order  problems,  we 
obtain  an  asymptotic  expansion  for  this  solution  of  the  full  TPBV  problem. 
An  example  illustrates  the  design  procedure  and  the  computation  of  a 
locally  optimal  solution  using  a  Newton-Raphson  algorithm  and  the  O(ji) 
approximate  solution  as  the  initial  guess.  Finally,  it  is  emphasized  that,  if  the 
fast  variable  z  in  system  (2)  is  unstable,  the  partially  closed-loop  control  (29) 
which  stabilizes  the  fast  variable  should  be  applied  to  the  system  (2). 


7.  Appendix:  Equivalence  of  x,  p  and  X*,  P0 

Let 


Uo--tf-'(6\Po+6‘2Qo).  (91) 

From  Eq.  (59-2),  we  have 

Zq  **  1  (dj  +  B2Uq) 

• -(^a  +  Suii"' ^-'(dj  +  ^Ar' (92-1) 
On  -  -A'f1  ( V2  +  2  V3Z0  +  A\P0) 

-  -^2  +  ^J/ir,V>3r,[(V2-2Vv4,',dj)  +  (A'1  +  V3aV$')PoI  (29-2) 
Therefore, 

-6'2(Ai+52A2l?3r\A\  +  v3aV$')]p0 
-\R-'B'2(A2  +  S2A'2-'V3r'(V2-2V3A'2'a2) 

-~\L3x[B\  +BiA'2-'ViAV?-B'2A,2-l(A'2  +  ViAVS2) 

•  (Aj  +  ^Ar1  V3r'(A;  +  V3AV§)]P0-kL3'B'2A'2' 

■  (A'2  +  V3A2x§2)(A2  +  §2A'2x  V3r\ V2  -  2  V3A2x&2) 

-  AL3\B i  +B2A'2-'  P3AVS-B'2A'2-x(A\  +  V3A2_15)]Fo 
-hLl'§'2A2'(V2  -  2  V3A2lS2 ) 

--l;'(l2+\B'Po). 


(93) 
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Substituting  Eq.  (93)  into  Eq.  (59-1)  yields 

dXo/dt  -  (d,  -  A,  A? ‘d2)  +  (fl,  -AxA2lB2)Uo  -  d  +  §U0 ,  (94) 

dPo/dr  =»-[V,x+ZiV2x+ZJ  V3xZo  +  (7i*x  C/0 

+  /*o(di,  +AlxZo  +  B\xUo)+Q'o(&h  +  AzxZo  +  SixUo)Y 

-  -[  Vlx  -diAr'  V^+diAi"'  V3xAJld2 
-(Vi  —  2diAi_1)A2 ‘(dj-Aj^Aj 'd2) 

+  Po(du  +  Ai*^  *( —  &2  —  B2Uo)  +  B\xUo 
—  A  iA2  1  (d2x  —  A  2xA2  1  (d2  +  BiUq 
+B2xU0)))+U'0(-B'2A21  VJx  +2SiAi“l  V3xAi‘d2 
+  2B2A2  1  VjA2 l(d2x +A2xd2)  — B2xA2  '( V2  — 2 VjA2‘a2) 

-  Ji  Ai" 1  Ai.A  i‘ 1  ( V2  -  2  V3  A  2‘ 1  d2))  +  U'a  (Rx  +g'2  A?  VixA2l  B2 
+  2  JiAi'*  VjAi'1  (  -A2xA2-‘B2  +  52x))C/0]’ 

-  -[Llx  +2U'oLu  +  C/U.3xt/0  +  Pi(dx+B.C/o)]’ 

-  -VxH(X0,  Po,  U0,  t).  (95) 

In  Eq.  (95),  the  partial  derivative  of  an  rti  x  n2  matrix  G  with  respect  to  x 
results  in  an  ni  x  n7x  n  matrix  G,  and  its  premultipiication  and  postmulti¬ 
plication  by  an  nt -vector  h\  and  an  n2- vector  h2  is  defined  as 

h[Gxh2  =  £  £  h\ih2,GijX,  (96) 

•-1 /-i 

where  hu  is  the  f'th  component  of  h\,  h2i  is  the  /th  component  of  h2,  andC7„  is 
the  (<,  /)th  element  of  G.  Thus,  the  equations  for  X0,  Po,  U0  are  identical  to 
the  equations  for  x,  p,  u.  Hence,  from  the  uniqueness  Hypothesis  (HI), 

Xo~x*.  P0  =  p*,  Uo-u\  (97) 
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stochastic  control  of  linear  singularly  perturbed  systems  with  quadratic 
performance  index  and  Gaussian  noise.  Some  of  the  results  of  the 
filtering  problem  [9]  and  the  regulator  problem  [3]  carry  over  to  the 
combined  Lineer-Quadratic-Gaussian  (L-Q-G)  control  problem,  but 
there  are  important  differences.  The  major  difference  from  the  determin¬ 
istic  control  problem  is  the  presence  of  the  white  noise  which  can  result 
in  an  ill-defined  quadratic  performance  index  in  the  limiting  procedure. 
Similarly,  the  stochastic  control  problem  differs  from  the  estimation 
problem  in  that  in  the  estimation  problem  one  may  be  required  to 
minimite  the  error  variances  of  the  fast  and  slow  states  (which  have 
different  orders  of  magnitudes);  these  variances  appear  separately  and 
not  in  a  single  sum.  In  the  control  problem,  the  quadratic  functional  to 
be  minimised  may  contain  a  sum  of  terms  involving  such  covariances 
and  one  of  these  terms  may  dominate.  Therefore,  the  singularly  per¬ 
turbed  stochastic  control  problem  considered  here  contains  new  aspects 
not  present  in  the  earlier  results. 

The  system  to  be  controlled  is  assumed  to  have  been  transformed  by  a 
nonsingular  transformation  [10]  into  the  block  diagonal  form 

x»A.x  +  B,u+G,»  (1)' 

pim  Ats  +  Bju  +  Gjw  (2)' 

with  observations 

y  m  C„x  *  C2r  +  v  (3) 

where  x,  r,  y  and  u  are  a-,  at-,  q-  and  r-dimensional  vectors,  and  w  and  c 
are  uncorrelated  white-Gaussian  noise  vectors  with  covariances 

£{w(/)w'(r))-G(»)«(t-r) 

£{0(/)„'(r)}. *(/)»</- r).  (4) 
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Absomct — TMs  paper  applies  singular  perturbation  theory  to  the 
tteebnsrtc  control  for  the  Lhteer-Qoeihsrtr-GeRjdnn  (L-Q-G)  proMeni 
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obtained  m  a  combination  of  a  slow  control  sad  a  fats  control  coa^aled  la 


The  parameter  p>0  represents  small  time  constants  and  similar  physi¬ 
cal  quantities  making  (2)  the  fast  subsystem  since  as  *-*0,  then  oo. 
There  is  no  lots  in  generality  in  considering  systems  of  the  form  (1),  (2) 
which  have  been  uied  in  the  filtering  [9]  and  the  time-optimal  [6] 
problems  to  simplify  the  derivations.  For  At  nonsinguiar.  every  singu¬ 
larly  perturbed  linear  system  can  be  transformed  into  the  form  (1),  (2) 
and,  therefore,  all  the  results  and  derivations  bold.  In  applications, 
however,  there  is  no  need  to  actually  perform  the  transformation. 

The  problem  is  to  determine  the  control  u(t)  as  a  functional  of  past 
observations  {y(r),  i„  <  r  <  r)  to  minimise  the  performance  index  J 
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Motivated  by  previous  results  for  the  regulator  [3]  and  filtering  (9) 
problems,  the  objective  of  this  paper  is  to  decompose  the  optimal 
stochastic  control  problem  into  two  separate  problems  for  slow  and  fast 
subsystems,  and  to  investigate  the  near  optimality  and  limiting  behavior 
of  the  solutions. 


1.  Introduction 

The  singular  perturbation  approach  [1|  to  the  linear  regulator  and 
filtering  has  decomposed  the  problem  into  two  lower  order  problems 
treated  separately  in  different  time  scales  for  fast  and  slow  subsystems 
(2H91-  As  a  continuation,  this  paper  presents  the  results  for  the 
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Depending  on  the  stability  of  the  matrix  4  j(r),  one  of  the  two 
following  assumptions  is  fundamental. 

Assumption  l:  For  every  fixed  t  e[/,,iy|,  the  eigenvalues  of  A  Jr)  have 
negative  real  parts.  ReX{Aj(i))  <  3<0. 

Assumption  2:  For  every  fixed  /  € ( r„, if},  the  matrix  /t2(r)  is  nonsingu¬ 
lar,  the  pair  [^](r),C2(i)|  is  detectable,  and  the  pair  [rfj(r), 52(r)[  is 
subilizable. 

In  addition,  it  is  assumed  that  ail  the  matrices  appearing  in  (IMS)  arc 
continuously  differentiable  functions  of  t. 


'As  it  is  customary  to  L-Q-G  analysis,  the  diffcrunttsl  equation  form  >s  retained  to 
imply  an  I  to  stochastic  dlftarunttal  equation.  Dus  to  the  linearity  of  the  problem,  no 
difficulties  arise  from  this  standard  practice. 
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(a  (he  next  section.  ■  fast  control  problem  will  be  considered  first. 
Then  (he  complete  system  solution  will  be  discussed  and  a  reduced-order 
problem  will  formally  be  defined.  Finally,  the  study  of  the  limiting 
behavior  of  the  complete  system  solution  will  be  made  by  using  both  the 
reduced  and  the  fast  problems. 

II.  A  Fast  Control  Problem 

We  first  formulate  a  fast  control  problem  as  having  the  system  state 
and  observation  equations 

HZ~A2z  +  flj«+  Cjw  (6) 

yy-Cjr  +  c  (7) 

for  which  we  are  to  determine  the  control  u  as  a  functional  of  past 
observations  yf,  minimizing  the  performance  index  J, 

J,~E  {  i  +  « («) 

The  optimal  control  Uf  is  obtained  in  a  straightforward  manner  by  using 
the  separation  principle,  so  that 

(9) 

where  K2  satisfies  the  Races u  equation 

4*1  -  -  Mi*j  +  *2-*2  +  f-ll  +  K2B2S  ~  'B{K2.  *,(/,) -IV  (10) 

Here  zf  denotes  the  optimal  estimate  of  z(r)  given  the  past  observa¬ 
tions.  which  for  any  given  u(r)  is  the  output  of  the  filter 

f*i/“  ^  J*/+  P2C2R *'[/,- Cji,]  +  B2uJ,(l.)  -  E  { lU.) )  (II) 

where  P^i)/ it  is  the  error  covariance  of  zf  satisfying 

nP2-A2P2+P2A‘2  +  G2QG2  -  P2C2 R  -  'C2P2. P2 ( /„) -  M cov ( i ( ».)) 

(12) 

which  does  not  depend  on  u(t).  The  resulting  minimum  value  Ju  of  J,  is 
V -  ~  jy  {  [ ; K2P2Ci R  - 'C, ] P2 }  di  + ;  tr  [ P2 ( I,) r, ] 

A-'2pi0JK20.)iUol  (13) 

If  a  control  *•  satisfying 

uf-uy+u,*  -  S~'B2K2zf+u,  (14) 

is  applied  to  both  the  system  and  filter  in  (6)  and  ( 1 1 )  as  shown  in  Fig.  1 . 
then  the  value  Jf  of  J,  can  be  expressed  by 

if  mjh  ♦  XI  -  JK  +  ±  f  ''E  { u\Su, )  dr.  (15) 

These  results  are  now  used  to  establish  the  limiting  behavior  of  the 
optimal  control  and  the  performance  index  for  the  fast  system  (6). 

The  properties  of  i,  and  P2  as  it— 0+  have  already  been  considered  in 
(9|  and  are  briefly  summarized  here.  If  either  Assumption  I  or  2  hold, 
then  the  estimate  of  i,  and  the  covariance  P2/ it  of  the  error  ( z-z, )  for 
any  given  u  are 


i/-i„  +  ;„(F)  +  0U,/J).  #-«-».)/» •  (16) 

Pi’Pi  +  Pii*)*  0((i)  (17) 

where  P2  is  the  solution  of  the  algebraic  Riccati  equation  for  every  fixed 

'  e  1 

0-  A2P2*  PjAi+  G2QG2  -  P2C2R  -  'C2P2  ( 18) 

and  P2(9)  (which  is  not  a  covanance  matnx!|  satisfies  the  boundary 
layer  equation  at  r0 

■£P2(»)-A2U0)P2+  P2A\ Ua)-P2C2{,JR-'C2( ta)P2,  9  > 0 

JV0)-Mcov(z(r.))-F2<t.)  (19) 

A2^[a2-P2C2R  'C,].  (20) 

Since  A2  is  a  stable  matrix,  it  can  be  shown  that  the  solution  of  the 
unforced  Riccati  equation  (19)  tends  to  zero  exponentially  fast  in  9.  even 
though  P2(0)  may  be  negative  semidefinile. 

The  estimate  ij,  is  the  output  of  a  filter 

£z. - At0,K  +  Fj  (r,)Cj  (/, )R  - 1  [ y, -  C2i„]  +  B2u,  f„(0) - z(0) 

(21) 

which  is  stationary  in  a  time  scale  r  — (r-r,)/(i  stretching  every  small 
fixed  subinterval  (/,./,  +«jcf/„^|.  The  matrices  in  (21)  are  all  consunt 
with  respect  to  r  and  depend  on  r,  €|0.r^|  as  a  fixed  parameter. 

The  boundary  layer  term  z„{9)  satisfies 

^z.l9)-AI(,0)iJ9)*P2{9)CiUJR-  '[yf- Cji.],  ;„(0)-0 

(22) 

which  may  be  considered  as  the  output  of  a  stable  time-invariant  system 
(system  matrix  A2)  driven  by  white  noise  (whose  covariance  is  0(1  /»  in 
the  9-variable)  which  is  multiplied  by  an  exponenually  decaying  gain 
P2(9).  Consequently,  the  covanance  equation  of  z„(0)  may  be  derived, 
and  it  then  can  be  shown  to  be  bounded  by 

iM,exp{-a-^).  (23) 

It  is  thus  shown  in  (9)  that 

i,-z„  +  Ofu'^)  (24) 

/>2-Fi+0(ii)  (25) 

for  te(r'.r^]  where  r'  >  i„. 

The  limiting  behavior  of  the  optimal  control  is  obtained  when  the 
expression  for  K2  is  used  in  conjunction  with  the  filter.  The  behavior  of 
K2  has  been  analyzed  in  (3|  and  under  Assumptions  I  or  2  it  may  be 


written  as 

AC2-*2+*i(<»)  +  0<m).  »«<»,-(>/ p.  (26) 

The  gain  AT,  is  the  solution  of  the  algebraic  Riccati  equation 

0-  A 2K2  +  K2A2  +  f-2  -  K2B2S  -  'B2K2  (27) 

and  the  boundary  layer  term  K^a)  at  t,  satisfies 

K2  ( o )  “  A  2  ( tf )  A  2  "S  K2A ,  ( if  l  -  k2B2  ( it  )5  tB2{if)K2-  s  >  0 
k2  (0>- 12  -*,(/,)  (28) 

A  2*  .42-9,5  '*2^2-  (29) 

The  boundary  layer  term  K:  may  be  bounded  by 
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0(</-O 

|  exp - -  (30) 

where  3/]  is  of  the  order  of  r 2-  K£>/)-  Hence,  for  ref/,/'),  where  '"<(/, 
we  may  write 

*i-*j+0(M).  (31) 

In  this  way  the  optimal  control  is  approximated  by 

*f  m  tf + (*  )  +  *)>(<•) '<=['..</!  (32) 

where 

uf--S-'*iKJi.  (33) 

and  Uf  and  Uf  are  the  layer  correction  terms 

«,(*)- -S-'B&i.it),  ^(e)--S-'«i*j(«)r..  (34) 

If  these  terms  are  ignored,  the  approximation 

«,-«,+<)<  *,/J)  (35) 

is  valid  on  a  subinterval  [(|.»ilc  [(„.//!■ 

In  analyzing  the  effect  of  replacing  Uf  by  its  approximations  (32)  of 
(33),  several  cases  are  of  interest.  It  is  easy  to  verify  that 

E  { UfSUf  (t.)B2S  ‘  '*i*j  (/„)]*,  exp  -  (36) 

so  that  if  then 

/,«!/''£  {u^jdf-IH,,*).  (3?) 

y,e 

Similarly. 

i  fl(i.-t) 

£  { s£S*. }  <  -^tr  { [*,£,5  -  ]«,  }  exp - (38) 

where  M,/p  is  £  (z,(t/)z,(‘/)}.  and  hence  Af3  is  finite.  Consequently,  if 
Afj-Ofje'),  then 

Jfm\j,'E(^Suf)dt~0(^).  (39) 

The  parameters  i  and  j  in  (37)  and  (39)  are  included  to  account  for 
several  possible  cases  of  behavior  of  the  weighting  matrices  £j  and  r2  as 
as  discussed  below. 

To  sec  the  effect  of  replacing  the  optimal  control  i if  by  the  control 
uf  •  up  we  use  (14),  (13)  with 

which,  when  combined  with  (37),  (39)  results  in  the  performance  index  Jf 

JrJM+J/,+Jf,+<Xp.).  (40) 

Two  cases  need  to  be  considered  to  determine  the  relative  magnitude 
of  Jf,.  Jf.  and  Jf.  It  can  easily  be  seen  from  (13)  that,  in  general, 
/^•Ofl/p)  which  is  due  to  the  white-noise  behavior  of  the  fut  variables 
in  the  limit  as  r-»0+.  If  now  £,*0  as  p->0+,  then  from  (27),  (37),  and 
(39)  /A“0(l),  /A  -  Of  I ),  so  that  the  relative  error  in  performance  is 
expressed  by 

//-y>(i+o(M)]+0()»).  -k-of-j)-  <«D 

If  now_£j- a£j,  then  from  (27)  £j*0(p)  provided  A2  is  stable,  other¬ 
wise,  K2  will  tend  to  a  nonzero  limit.  In  this  case  if  (28)  is  also  used, 

^e-Od).  ^-OdlTjli1).  (42) 


Consequently,  if  in  addition,  the  terminal  coat  r2  is  small,  I^w 
then  /A- 0(p),  and  (41)  is  still  valid.  It  should  be  noted  that  while  in 
both  cases  the  relative  increments  in  the  performance  index  resulting 
from  neglecting  the  boundary  layers  are  0(  p),  the  absolute  increments 
are  0(1)  in  the  first  case  and  0(  p)  in  the  second.  The  importance  of  the 
latter  case  is  also  evident  from  the  fact  that  ifm0( pl/l)  so  that  since  the 
system  is  stable  no  control  is  really  necessary  due  to  Lj-0(p).  (Note 
that  J^-Ofl)  stems  from  the  covariance  of  the  fast  states  which  behave 
like  white  noise  as  p-»0+).  In  the  case  of  finite  Lf,  in  order  to  achieve 
an  absolute  0(  p)  approximation  to  Jf,.  the  near  optimal  control  should 
include  the  sum  of  i tf  and  the  two  layer  correction  terms. 

These  results  are  summarized  in  the  following. 

Theorem  I:  Let  Assumption  2  hold,  then  the  limit  as  p— 0+  of  the 
solution  of  the  fast  optimal  control  problem  (6H8)  satisfies  (32).  Fur¬ 
thermore,  the  limits  of  the  performance  index  when  Uf  or  if  are  used  are 
given  by  (40)  and  (41).  If  instead.  Assumption  I  is  satisfied  and  L2mitL2. 
then  (42)  holds. 

III.  The  Couplet*  Control  Pxoblem 

We  no*,  return  to  the  stochastic  control  problem  for  the  complete 
system  (IH3).  The  solution  when  p>0  is 

U.--S-'  {(£;*,  +  ***;, ]i.  ■►[m*;*, 2 (43) 
where  the  gains  satisfy  the  Riccati  system 

*,  -  -  (A‘K,  +  *,/!„  +  *-.)  +  <  *.*.  +  *,  A  )S  - '  ( *, B,  +  K)2B2 

*,('/)-  T,  (44) 

-(/f,2/fj  +  («A'/f,2+  £|2)  +  (£|£„  +  £|j£j  )■$  _l  (  p£.'£|2  +  B{Kj ), 

«.2('/)-ro  <45> 

P*2  -  -  ( A2K2  +  K2A2  +  £j)  +  ( K2B2  +  HKI2B,  )S  ‘ 1  ( itB^Kl2- ►  B2K2 ). 

*j('/)-r2.  (46) 

Similarly,  the  opumal  estimates  x,  and  i„  are  obuined  from  the  linear 
filters  which  for  any  given  control  u  are 

i,  -  A .i.  +  ( Pi  C;  +  P, 2C2 )  R  '  ‘r  +  B,u  (47) 

P*.  ~  -4  2i.  ( fs/»,'2C^  +  P2C'2  )R  *'»+  B2u  (48) 

where  r(t)  is  the  innovation 

p(t)-y(r)-C.i.(i)-C,f.(r).  (49) 

The  error  covariances  satisfy 

p,  -  A.rx  +  rtA, + c,QG;-(  p,c;+  rl2a  )/?  ~  '(C.p,  +  c2p\2). 

F|(r.)-cov[x(/#)]  (50) 
^  u“M,^  u+  P  ijA2  +  C,0Cj-(£  |Cj+  P  ij  C2)R  1  ( itC,P \2  +  C2P2 ), 

/,u('»)”covI*('»)"f('<,))  (51) 

ltP2  m  A2P2  +•  PfA 2  +  G2QG 2  —  ( ltP[2C,  +■  P2C2  )R  ~ 1  (  uC,P  12  +C2P 2 ), 

/,2('.)"l*cov[r(i,)].  (52) 

To  investigate  the  limiting  behavior  of  the  optimal  control,  we  analyze 
the  limiting  behavior  of  the  filter  (47),  (48)  and  of  the  linear  regulator 
(43).  We  first  note  that  expressions  analogous  to  (14)  and  (15)  are  valid 
for/*  obtained  with  ir*  and  J,  obtained  with  u,.  The  dominant  contribu¬ 
tion  to  J,  is  due  to  the  fast  subsystem  since  it  contains  a  0(1  /p)  term. 
Therefore,  if  the  slow  subsystem  is  of  interest,  any  approximation  or  the 
limiting  behavior  should  include  both  the  0(l/p)  and  0(1)  terms.  Under 
the  conditions  of  Theorem  I,  the  contributions  of  the  fast  subsystem 
may  be  reduced  to  0(1),  comparable  to  the  contribution  of  the  slow 
subsystem. 
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where 


The  first  step  in  a  singular  perturbation  analysis  is  to  define  a  reduced 
problem.  The  reduced  problem  is  formally  obtained  from  ( 1 )— (5)  by 
setting  p»0.  We  point  out  that  this  is  not  a  valid  limiting  operation.  If 
A  2  is  stable,  it  is  valid  for  the  purpose  of  substituting  i  in  a  slow  system 
(Theorem  1  in  (9J).  However,  it  is  not  valid,  ia  general,  lor  the  purpose  of 
substituting  t  into  (5).  The  substitution  of  .V  -  -  Cyt  f  'fl2,  0 »  - 
Cytj  't7j  and 

r,--/<2_lI5ju-t-Gjiv]  (53) 

in  (1).  (3).  and  (5)  results  in 

xr  —  A0xr  +•  B0u+  G'W  (54) 

y  m  C,,x,  +  Nu  +  Dw  +  c  (55) 

JmE  {  I  f//lx'1-ix'~2x'LiiAf'S2u  +  u  ’$.“]<*♦  J  *Ji 

(56) 

(57) 

Here  /,  contains  terms  not  influenced  by  the  control,  some  of  which, 
such  as  the  integral  of  the  variance  of  the  white  noise  w,  are  ill-defined. 
Therefore,  only  the  terms  which  may  be  affected  by  the  optimization  are 
given  in  (5b).  The  optimal  control  u,  which  minimizes  (56)  for  the  system 
(54),  (55)  is  called  the  reduced  control  and  is  given  by 

(58) 

where  the  reduced  filter  for  any  given  u  satisfies  • 
ir~A.i,*[P0C-  +  GaQD]R- 1  [y  -  C„x,  -  .V„]  +  B0u. 

Ra-(R  +  DQD).  (59) 

The  gain  Ka  and  error  covariance  P0  satisfy  the  usual  RE's 
^--(A^.  +  ^  +  Z.,) 

+  ( K„B .  -LtJA{  'flj  )  S' 1  (  K„B0  -LtIA{ )'  (60) 

P.  -A°Po  +  Po  K  *  B.QB'0  -  <  P.Cj  +  G,QD-)R- 1  (C,P„  +  DQG‘ ). 

(61) 

The  asymptotic  validity  of  the  reduced  problem  is  established  in  two 
steps.  First,  the  limiting  behavior  of  the  fillers  (47),  (48)  is  investigated 
for  any  given  u.  It  follows  from  Theorem  2  of  [9]  that  under  Assump¬ 
tions  1  or  2  for  re(t'.ir],  t’  >  i„.  that 

i0-ir  +  0(yl/2) 

P,-P„  +  0(p).  P2-P2  +  0(p).  (62) 

Similarly,  using  (3).  (1 1]  for  /6[l#,l"].  i"  <  I y.  we  have 
tf,-Af,,  +  0<p).  K2-K 2  +  0<p) 

AT,j- -(  Z-,,- K,B,S  -  ‘fl2*2  )if 1  +0(  p) *  tf,2  -MX  p).  (63) 

Now  all  that  we  need  to  obtain  the  behavior  of  u„  as  p-» 0+  is  to 
substitute  u„  into  (48)  and  then  find  the  limiting  behavior  of  i„.  The 
substitution  of  (43)  into  (48)  yields 

pi.  -  +  PiCiR  '  '*•«)  -  B2S  ' 1  ( B;K,  +  B2Kn)i, -MX  Mi/Z).  (64) 

The  use  of  the  basic  result  in  singular  perturbation  theory  (see  [9])  allows 
i,  to  be  written  as  a  sum  of  two  terms 

K  -  A{  'S2S  - 1  ( B.K,  +  BiKn)i9+ zf+(*  Ml/2)  (65) 


A 2Zf+P2CiR  V(i)  B2S  (66) 

The  term  with  x„  in  (65)  is  only  needed  insofar  as  its  effect  on  the  slow 
system  is  concerned,  and  ia  relative  contribution  to  the  variance  of  r,  is 
0(  p).  The  second  term  :f  is  clearly  the  state  of  a  fast  system  with  white 
noise  input  r(r).  The  substitution  of  (65)  in  (43)  resultt  after  derivations 
similar  to  [1 1)  in  the  expression 

u„ -  -  S~ 1  ( K,B .  -LltA{  >5,  )  i. -  5  - 'fgf£+ 0(  M,/l) 

-  -  S' 1  (  K,B,  'Rj  )’k,  -  5  '  p1'2) 

*u,  +  u,+0(|*'/:).  (67) 

The  definition  of  ly  in  (67)  together  with  jy  in  (66)  imply  that  Uf  and  if 
are  the  same  as  those  discussed  in  Section  II  if  we  let>y—(>  -  C.x,).  It  is 
seen  that  the  optimal  control  of  the  complete  system  is  given  approxi¬ 
mately  as  a  sum  of  the  reduced  control  obtained  formally,  and  the  fast 
control,  which  is  performed  in  a  stretched  time  scale  and  is  composed  of 
a  stationary  term  and  two  boundary  layers. 

IV.  Near  Optimum  Performance 

The  effect  of  using  u,  or  ur  +  uf  in  the  singularly  perturbed  system  (I), 
(2)  on  the  performance  index  will  now  be  considered.  Again,  it  is 
sufficient  to  use  (14),  (15).  and  (32).  The  effect  of  using  only  the  reduced 
control  u,  is 

Jr-J,  +  Jn  +  J/r+±fy[KlB2S-'8iKi(v1-rl)}d,+0(v.)  (68) 

where  V2/p  is  the  unconditional  covariance  of  It  is  seen,  therefore, 
that  the  error  (■/,-/.)  is  0(l/p)  unless  the  fast  system  is  stable  and 
Lf  -  pX2.  In  such  a  case,  neglecting  the  fast  control  causes  an  error  of 
0(1).  If,  in  addition.  r2-pl/2T2.  that  is  the  fast  variables  are  stable  and 
are  of  little  interest,  then  avoiding  the  use  of  the  fast  control  resultt  in 
0 iii)  approximation  to  the  optimal  performance.  On  the  other  hand,  if 
the  fast  subsystem  is  unstable  or  if  it  is  of  sufficient  interesL  then  using  a 
sum  of  the  reduced  control  and  the  fast  control  results  in  0(  p)  approxi¬ 
mation  to  the  optimal  performance. 

These  results  for  the  case  when  the  fast  subsystem  is  asymptotically 
stable  are  summarized  as  follows. 

Theorem  2:  Let  Assumption  1  hold  and  let  L2-0(  p)  and  I*2« 
0(p,/2).  then  the  solution  to  the  optimal  control  problem  (1M5)  as 
P-*0  +  is  approximated  by 

u„-ur+0(p'/I).  /S[/'.r”]c[f,.fyl 

where  v,  is  the  optimal  control  of  the  reduced  problem.  If  ur  is  applied  to 
the  system  (I),  (2),  the  resulting  performance  index  J,  is  near  optimal  in 
the  sense  that 

-f,-./.+(Xp).  (69) 

A  more  general  case  is  summarized  in  the  following  theorem. 

Theorem  J:  If  Assumption  2  bolds,  then  the  optimal  control  u„  for  the 
system  (1H5)  as  p-» 0+  is  approximated  by 

u,  -  u,  +  Uf  +  0(  p 1  /: 1 )  »  u,  +  u,  +  Uf,  +  Uf,  +  0(  p 1 1 1 ) 

*u*  +  0(pl/J).  (70) 

If  u*  is  applied  to  the  system  (1).  (2)  the  resulting  performance  index  J* 
is  near  optimal  in  the  sense  that 

y-yo+0(p).  (7i) 

We  note  that  in  this  case  J ,  may  be  0(1/ p). 

The  significance  of  Theorem  3  is  that  the  separation  into  a  two  time 
scales  solution  is  valid  for  both  the  filter  and  the  controller,  as  was  the 
case  for  each  separately.  The  result  may  be  illustrated  in  Fig.  2.  While 
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the  input  to  the  itow  filter  incorporate*  the  entire  control  u,  +  up  which 
include*  a  fut  component,  it  ia  possible  without  low  of  information  to 
uae  a  low  pew  filter  10  that  Mich  input*  can  be  sampled  at  the  low  rate 
used  for  the  slow  filter.  Thi*  lead*  to  important  dmplificatioai  in 
real-tinM  operation  where  the  slow  computations  art  performed  by 
separate  dedicated  computers. 

V.  Exampu 

To  demonstrate  the  near  optimality  of  the  separate  time  scales  solu¬ 
tion,  a  simple  second-order  example  ww  considered  for  both  stable  and 
unstable  fast  subsystems.  The  system  equations  for  the  example  are 

-2.Sx  +  u  +  w 
Sir  ■  OjT + 2  u  +  w 
ywx+r+c 
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TABLE  1 

Tki  Optimal  Performanc*  ImmxJ,  as  a  Function  op  m 
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u 

J  for  a,  »  -3 
o  2 

J  for  a,  *  +3 
o  2 

0.01 

1.3245 

2713.80 

0.02 

1.8421 

1391.74 

0.04 

1.8306 

714.98 

0.07 

1.8386 

421.42 

0.1 

1.9972 

302.87 

0.2 

2.1973 

163.71 

0.4 

2.6206 

93.875 

0.7 

3.3045 

65.14 

Pig.  6-  Th*  oact,  radoead,  tad  liyar-eorwcwd  guaa  for  tha  ntihli 


0.  f,-l.  Q-2,  B-l,  i(0)-3,  l(0)-2 

i*,(0)-2,  ^u(O)- 1.3,  (0)  -  -i 

T|  —  2,  Tu-1.3,  Tj  — 3)t,  L|  - 1,  Lii—  L|  —  p,  S  — 1. 

For  tlx  liable  cam,  -3  tod  for  Uit  unstable  cam,  a2 “  +3.  The 
reduced  tad  fast  fllur  (Riiu  and  covariancaa  can  ba  calculaiad  analyti¬ 
cally  for  this  cam.  whila  a  computer  had  to  ba  uaad  for  tha  exact 
solution.  In  Fig.  3,  tha  exact  covanuaccs  for  the  stable  cam  for  p-0.1 
are  compared  to  thair  approximate  values  with  and  without  tha  layer 
corrections.  Similarly,  Fit  4  compares  tha  exact  pains  to  the  approxi¬ 
mate  pains  for  tha  stable  case  and  p-0.1.  Fip.  3  and  6  display  (base 
results  for  the  unstable  case.  The  performance  index  J,  was  computed 
for  several  values  of  p  and  is  shown  in  Table  I.  The  incremental  relative 
error  in  the  performance  index  when  only  tha  reduced  control  is  uaad 
and  whan  the  boundary  layer  terms  are  added,  are  shown  in  Pips.  7  and 


Fie.  S.  The  relative  oneaeau  ot  the  perforaeeee  index  {J.-JJ/J,  end  {/•  -JJ/J, 
for  ib»  n—fbU  cam. 

8  for  the  stable  and  unstable  cam.  respectively.  These  results  demon¬ 
strate  the  general  behavior  of  both  the  control  and  the  performance 
index  discussed  in  the  paper.  It  is  seen  that  as  expected,  the  relative 
increments  in  performance  decreaM  when  the  boundary  layer  terms  are 
added,  but  the  decrease  is  more  significant  in  absolute  terms  for  the 
unstable  case  since  Jf,  is  quite  large  for  small  p  illustrating  the  Ofl/p) 
behavior. 

The  choice  of  Lj  -  p  explains  the  fact  that  in  both  cases,  the  reduced 
cost  J,  is  very  does  to  the  optimal  cost  J,  and  not  much  improvement  is 
obtained  by  adding  the  fast  dynamics.  However,  a  different  choice,  my 
Lj-a a  where  a  is  a  larpar  constant  (a-p^  10)  may  remit  in  a  more  - 

significant  contribution  of  the  fast  dynamics,  so  that  /*  will  be  signifi¬ 
cantly  closer  to  J,  than  It  should  be  noted  that  since  .  represents  the  — 

relative  ratio  of  the  fast  time  constants  to  the  slow  time  constant,  values  I 

of  p>0.1  need  no  longer  conform  to  the  asymptotic  results  for  small  p.  ■— 
For  example  for  p-0.2  the  ratio  of  these  time  constants  is  1 :6  so  that 
the  fast  subsystem  is  really  not  ao  fast  anymore.  Furthermore,  for  p -<U,  f 
tha  interval  (0, 1]  is  equal  to  tan  fast  time  constants,  so  that  for  any  larger  1 
H  wa  are  getting  an  overlap  of  the  boundary  layers,  and,  therefore,  the  • 
asymptotic  results  art  no  longer  valid.  Them  observation*  explain  the 
behavior  in  Fig.  7  of  the  near  optimal  performance  for  p>(U.  The  m 
approximate  valuee  of  the  gains  and  the  oovariancee  for  p- 0.1  appear  to  I 
be  a  very  good  approximation  to  the  exact  value,  mpecially  after  tha  ft 
boundary  layer  corrections  are  made.  The  0(p)  difference  in  the  steady- 
state  values  it  mostly  unnoticeable  except  for  in  Fig.  3.  m 
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In  stochastic  singularly  perturbed  control 
systems  the  meaning  of  the  fast  variable  is  not 
always  clear  due  to  the  idealized  white-noise 
model.  In  this  paper  Che  linear  quadratic  sto¬ 
chastic  concrol  problem  for  a  singularly  perturbed 
system  is  reformulated  by  using  appropriate  para¬ 
meter  scalings  which  are  fractional  powers  of  the 
perturbation  parameter.  The  regions  of  these  para¬ 
meters  are  determined  so  that  the  variables  in 
boch  tliae-scales  are  well-defined,  resulting  in  a 
meaningful  two  time-scale  near-optimal  solution. 


I.  Introduction 

The  usefulness  of  the  singular  perturbation 
approach  for  che  analysis  and  concrol  of  decarmin- 
iscle  dynamical  systems  wlch  fasc  and  slow  modes 
is  evldenc  from  che  results  surveyed  in  [l].  One 
of  che  problems  encountered  in  extending  the 
deterministic  linear  regulator  results  for  singu¬ 
larly  perturbed  systems  co  filtering  [2]  or  smooth¬ 
ing  [3]  of  linear  stochastic  systems  stems  from  che 
idealized  behavior  of  che  white  noise  used  in  the 
models.  Fast  state  variables  may  themselves  be 
asymptotic  co  white  noise  as  in  [4] ,  in  which  case 
they  are  of  no  interest  for  estimation  purposes. 
Alternately,  they  may  be  included  via  the  usual 
formulation  of  singularly  perturbed  systems;  how¬ 
ever,  in  this  case  ohey  have  a  negligible  effect 
on  che  slow  subsystem.  The  extension  co  che  sto¬ 
chastic  concrol  problem  is  even  more  problematic 
[3,6],  as  che  flnice-cima  problem  becomes  an 
inf inlce-cime  one  for  che  fasc  states.  Past 
attempts  Co  include  control  of  the  fasc  state 
variables  have  either  permitted  a  divergent  per¬ 
formance  index,  or  used  separate  performance 
indices  for  che  fast  and  slow  subsystems.  An 
alternative  approach  co  circumvent  such  diffi¬ 
culties  is  to  allow  colored  noise  only  (as  in  [7]) 
which,  in  a  sense,  limits  che  significance  of  the 
fasc  subsystem. 

The  problems  arising  in  che  scandard  singu¬ 
larly  perturbed  formulation  of  linear  systems  with 
white  noise  input  may  be  illustrated  as  follows. 
Suppose  a  fasc  state  z  satisfies  the  following 
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ui(t)  »A2(t)s(c)  ♦  Gj(t)w(t)  (1) 

whara  w(c>  is  white  nolae  wlch  covariance  matrix  W 
and  u  >  0  is  a  small  parameter  representing  che 
small  time  constants  in  che  system.  If  the  matrix 
A2(c)  Is  a  scable  matrix  (eigenvalues  for  every  c 

have  negative  real  parts),  chan  as  u  -  0+  the 
process  z(c)  tends  co  a  white  noise  vector,  wlch 
infinite  variance  parameter.  More  precisely,  since 
che  limit  does  not  exist  in  che  usual  sense,  the 
limit  is  to  be  interpreted  as  follows 

el  C1 

j  *(t)dt  -  j*  -A*lC2dU(c)  +  0(11*).  c2  as  cQ  >  0. 

°  °  (2) 

where  U(c>  is  che  Wiener-Levy  process  defined  as 
the  integral  of  w(c).  He  have  used  che  notation 

f(t)  ■  0(uf*)  to  mean  chat  there  exist  constants  c 

and  u*  such  chat  E(i|  £(  c)||  2]S  Cu2*  for  u  6  (0,u*]. 
The  results  implied  by  (2)  mean  chat  z(c),  while 
not  representing  a  meaningful  physical  fast  vari¬ 
able  in  its  own  right  (having  infinite  variance), 
does  have  a  finite  contribution  as  an  input  co  a 
slow  system.  This  contribution  co  a  slow  sub¬ 
system  may  be  found  for  small  enough  j,  by  replac¬ 
ing  z  wlch  its  white  noise  llmic.  In  order  co 
allow  z  co  represent  a  fasc  scochasclc  variable 
with  finite  variance,  one  may  use  the  following 
formulation 

az  -  A2z  *  u*G2w  (3) 

In  this  case,  z  has  a  well-defined  meaningful 
limit  in  che  fasc  cine-scale  rw  c/u.  so  chat 


d7  1  "  *2*  *  52" 

(4) 

where 

z(t  )  -  Z(u7  ) 

(5a) 

w(r  )  ■  u*w(ut ) 

(5b) 

It  should  be  noced  chac  w(r )  is  a  valid 

white  noise 

process  in  the  stretched  time-scale  r, 

such  chac 

E[^(t1)w,(t2)]  -  W5(t1  -  t 2 ) . 

(6) 

However  the  contribution  of  z  as  an  inpuc  co 
i  slow  syscem  becomes  negligible  in  this  case, 
s  lnce 

,1  1 

j  *(e)de  •  O(u’)  ,  c,  i  cQ  >  0.  (7) 
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The  objective  of  tbit  paper  is  to  explore  the 
poeslbilicias  of  introducing  appropriate  weighting 
paraaa car*  ai  powers  of  u,  into  cha  system  f ormula- 
don  of  a  llnaar  seoehaadc  control  problem,  so 
chat  tha  resulting  two-time  scala  near-optimal 
solution  ia  aaaningful.  Tha  fomilaeion  should 
allow  tha  two  axcraaa  casai  diacusaad  abova  in 
addition  to  othar  intermediate  caaaa.  Tha  rala- 
ciona  among  cha  paraaacara  that  result  in  a  wall* 
poaad  problaa  will  ba  axplorad.  Tha  earn  wall* 
poaadnaaa  ia  uaad  hara  to  imply  chat  tichar  ona  or 
both  variablaa  nay  rapraaant  physical  variables 
(f inlta  varlaneaa),  chac  cha  concrol  problems  in 
aach  tlaa*acala  ara  aaaningful,  and  chat  cha  par* 
formanca  Index  does  not  bacoaa  Infinite  in  cha 
Halt.  Tha  discussion  is  limited  to  the  casa  of 
a  stable  matrix  A,  (tha  fundamental  aacrlx  of  cha 
fast  sub system),  c or  simplicity  cha  heuristic 
notation  of  differencial  equations  is  used  through¬ 
out,  since  cha  syscaas  are  linear-,  however,  sto¬ 
chastic  diffaranclal  calculus  wlch  Wiener-Levy 
processes  may  ba  employed  co  derive  cha  rasulcs 
with  minor  changes. 

In  cha  next  section  the  problem  is  formulated. 
The  opdaal  exact  solution  and  its  limiting  be¬ 
havior  are  provided  in  Sacclons  III  and  IV. 

Finally,  discussion  and  analysis  of  the  rasulcs  ara 
given. 


Tha  par ama tars  a,  3,  v,  6  era  chosen  to  represent 
the  various  limiting  conditions  as  discussed  in 
Section  I.  They  rapresane  tha  relative  slsa  of 
the  snail  parameters  vithin  tha  systaa,  relative 
to  cha  small  dae  constants  of  cha  fast  subsystem. 
Any  given  syscaa  may  ba  partitioned  into  several 
fast  subs cates  with  diffarane  paraaacars,  even 
chough  wa  only  study  a  syscaa  with  one  such  sec  of 
paraaacars.  Tha  inclusion  of  a  separate  observa¬ 
tion  channel  yj  for  che  fast  subsystem  is  essen¬ 
tial  in  this  casa,  since  for  or  >  0,  cha  fasc 
variables  cannot  ba  esciaacad  in  a  aaaningful 
manner  from  cha  slow  observation  channel  (signal- 
co-noisa  ratio  tends  co  zaro).  Note  chac  for  cha 
previously  considered  case  [5],  a  *  9  *  y  •  0,  y2 

may  ba  combined  wlch  y. .  In  chac  case  S  “  ^  in 
order  co  yield  a  finite  performance  index,  so  thac 
cha  fasc  variable  was  of  no  interest  as  far  as  cha 
concrol  is  concerned,  and  served  only  as  a  nodal 
for  a  wlda-band  disturbance  co  the  slow  variables. 
Tha  objaedve  of  this  study  is  Co  Investigate  che 
limiting  behavior  of  cha  optimal  stochastic  con¬ 
trol  problaa  (8)-(l3)  as  u  -  0  .  In  particular  a 
near  opciaal  two  time-scales  solution  is  desired, 
such  chat  cha  problem  ia  wall-posed  in  both  time¬ 
scales.  Finally,  the  regions  of  che  values  of  cha 
parameters  or,  3,  v,  5  are  co  be  determined  so  chac 
che  resulting  problaa  is  we  11- posed  end  has  a 
aaaningful  solution. 


II.  Problem  Formulation 


The  singularly  perturbed  system  co  ba  con¬ 
sidered  is  modeled  by  cha  following  linaar  stace 
equations 

*l'  •  Vl  +  A12x2  +  V  *  °lw-  W  •  *10  (8) 

uij  -  a*A21xl  +  A2x2  +  B2u  *2<eo>  *  *20  (9) 

observed  in  additive  white  Gaussian  noise  as 
follows 

yl  *  CH*l  +  C12*2  *  vl  <l0) 


y2  -  ♦  CJ2x2  ♦  uVv2  (U> 

Hara  cha  state  vector  x  -  [xJ.Xj]'  is  partitioned 
into  its  slow  (x^)  and  fasc  (x,)  subecates  with 
corresponding  observation  vectors  y^  and  y2.  Tha 

parameter  ±  is  as  defined  in  Section  I,  and  the 
processes  w,  v^,  v2  are  assumed  co  be  independent 

white  Gaussian  with  covariances  W,  V^  and  V2 


respectively,  with  positive  definite  V.  and  V2. 
The' initial  conditions  x,.  ara  assuaed^co  be  4 
Gaussian  with  zero-means  and  covariances  with 
cov(x2g,x2(J)  m  u®X22.  The  control  variable  u  is 


common  co  both  subsystems  and  is  co  be  ehosen  as  a 
functional  of  paec  observations  in  order  co  mini¬ 
mize  cha  performance  index: 


where 


J-e(i  xTx| i  ^/ix'Qx  +  u'Ru]dt}  (12) 


‘  1 


12 


'  121 


1  2  J 


.  <3 


44  *  44 


!>'  44  a2s44J 


From  (9)  it  can  be  shown  chat  cov(x2>x2)  « 

0 (u*)>  a  -  min(a,9):  hence,  in  order  co  Insure 
chae  che  primary  contribution  to  Cha  stace  x,  is 
due  to  the  fast  variable  we  shall  use  tha  con¬ 
straint  3  a  a.  Relaxing  this  constraint  should 
causa  no  difficulties  and  may  be  created  in  a 
similar  manner.  Similarly  from  (9)  and  (11)  it  is 
easily  seen  chat  if  V  >  a,  the  fasc  variable  will 
be  observed  noiselessly  in  the  limit  (u  -  O'*), 
hence  cha  restriction  0  s  v  S  cr  is  imposed. 
Finally,  if  or  >  ^,  cha  problem  becomes  determin¬ 
istic  in  che  limit  as  u.  -  0*,  and  consequently  we 
shall  consider  the  region  OSiS  ^  only.  These 
constraints  may  be  written  as 

0SYSa£3S»|  ( 14) 

since  if  9  >  ^  Cha  coupling  beeween  x^  and  x,  may 

ba  nagLecced  as  being  of  order  less  chan  0(u4 .  It 
can  also  ba  observed  from  (9)  chac  cha  covariance 

of  xj  is  OCu^*  4,  a  face  which  will  be  utilized 
in  che  fil earing  covariances.  Next  cha  soluclon 
of  the  stochastic  concrol  problem  and  its  limits 
will  be  considered. 

ill _ ag&iaai-sgiimga 

The  separation  principle  may  be  used  to  ob¬ 
tain  the  optimal  concrol  soluclon  of  che  problem 
posed  by  (S)-(13).  The  control  gain  matrix  K  and 
che  filter  error  covariance  meerix  P  may  be 
partitioned  as  follows: 


’4 

*«l2l 

'?l  ‘*P12  ' 

K  - 

.‘42 

.  P  - 

s*to‘lP2 

Tha  optimal  control  u*  and  the  filtering  equations 


(13) 


for  i  will  ch«r«for«  b«  glv«n  by 

u*  -  -R*l((>iK1+82Ki2)il+<B2K2'^8i1C12>*2’  (l6) 

ix  -  *1Sl-^12*2+Blu*<P1C{+if,'VP12CJ]V*lv(e)  (17) 

ui2  -  ki3A21il+A2x2+B2tt»+u3'CuP[2C{-Ki3,‘VP2C^v‘lv(e> 

(18) 

where  the  innovations  proeast  y(c)  is  defined  by 

>i(t>  I  fcu  c12 

v(t)  $  -  | 

u  Vy2(t)_  i_c21  U  c22  J  _*2  - 

■  y(e)  -  Cc2  *\li  .  (19) 

Note  chac  (19)  Is  also  used  co  define  y,  C,,  and 
C,,  and  che  matrix  V  Is  defined  by 

2  f  V  ft  1 


It  should  be  eaphseized  ehae  y(c)  is  a  standard 
Innovations  process  in  che  slow  doe  scale  (vhica 
with  finite  covariance).  Furthermore,  the  filter* 
tng  equation  for  »2  has  the  same  fora  as  the 

original  scace  as  far  as  che  u3  term  multiplying 
the  white  input  v(t)  is  concerned.  The  gain 
matrices  satisfy  the  usual  Rlccacl  equations, 

-*l  “  Vl^K12*21+*iKl^BA21Ki2+i-iI-l 

■(Ki2Wi)ll"l(,iK1+*2Ki2)'  Kl<ef)'ri*  (2U) 

-■‘k12-Vl2+K12A2^K12+l‘aA2lK2+^i4 

*<K12B2+Kl8l)R‘l<B2VJliK12)-  «12<V  ri2 

W2*2  V*  K[2A12+uA'2K12 

•(KjBjfulCijB^R'^BilCji-uB^j).  ^(Cj)-  Tj  (21c) 

It  can  be  shown  that  u  *  -  C+  the  Limiting 
behavior  of  che  gains  become 


*12  •  *i2  ♦  +  0(U),  9  -  (22b) 

*2  -  Kj  +  *j(9)  +  0(n)  (22e) 

where  *^(9)  and  KjCS )  represent  boundary  layer 

terms  and  will  not  be  given  here  due  co  space 
limitations.  The  ocher  terse  in  (22)  are 

”XO"XO^AO"B08O^Q*'O^^AQ*BO8O  W*0 

>  VV  ri  <23,) 

OK2A24*’'ii2+ u254L.2**2a2R'lBJ*2  (23b) 

O-K0*12-Htl2A2i-u3A  )  R  '  V  Kj 


Ao"Al”J,B *12*2^*21'  8o"8l**12A2'82’  V"j5 


I-O'H  *  l2*2  *21'  ro  " 

Mote  chat  for  che  stable  cats  considered  here 

«■  2£  m m 

*2  *  0(u  )•  The  gains  *Q  and  *2  represent  che 

gain  solutions  for  the  reduced-order  slow-control 
problem  end  cha  infinite-time  fast-control  problem, 
respectively  [3].  Similarly,  cha  Rlccacl  equations 
for  che  filter  covariances  may  be  vrlcten  as 

pi*ipi^iAi*u\2pi2*“%2Ai24€i“ci 

-(PlC^u£,"^l2Ci)V*l(ClPl*ua'YC2Pi2) .  Pl(t0)-K1 
»  (23a) 

»P12-  Vil*!** 

-(PlC^uaf*VPl2CpV*l(uClP12+u“‘YC2P2). 

P12(e0>*ltl2  <25b> 

*<‘*Pl2Ci+ua*Vp2C2)V*l(,4ClP12+*‘a*Y(:2P2)’ 

P2(t0)-  ul*to*2  (23c) 

The  limiting  behavior  of  the  resulting  covariances 
may  be  found  by  duality  co  che  control  case, 

P,  -  ?„  ♦  0(u)  (28») 

1  U  t-t 

P12  *  P12  +  P12(X>  +  0(li>*  X  ’  “T*  (26b) 

P2  “  P2  +  P2(X)  +  0(w,)'  (26c) 

Hera  again  cha  boundary  layer  terms  P^2  and  P2 

will  not  be  given,  while  Che  remaining  variables 
are 

W“xi  (27*> 

O-AjPj-rfjA^-tGjWC^-  uZ(a,*V>P2C2V*lC2P2,  (27b) 

0- 

tC1W^-u<o'V>(P0Cj[+  uar'Y?12C2>v'lc2R2,  (27c> 

where  che  system  matrices  are  defined  by 

C0"V  Y<*2A2^A21*  V  *  C2A2  C2 

°0*G1*  '*aA12A2l52’  vo  *  V  +  °0n0  (28) 

Again,  it  is  observed  chac  P.  and  ?2  are  cha 
covariances  of  che  f lltering  problems  defined  by 
che  reduced-order  slow  system  and  che  quaslscesdy- 
state  fast  system,  respectively. 


In  order  co  transform  the  filter  and  hence 
che  control  Lnco  its  alow  and  fasc  components,  che 
following  transformations  co  (17)-(18)  are  intro¬ 
duced  after  first  substituting  (16): 

1  .v 

’’j  •  Rj  -  u  M(Tx^  ♦  Xj) 

^2  •  T»2  f  x2  (29) 


where  T  and  H  satisfy  cha  dlf farenclal  aquations 

(3C) 


-  f2t  -  r2l 


uKF1  -  FUT) 


uM  -  -MHj  *  Hx  *  u<Fl  -  FUT>M 
Tha  matrices  F  and  K  ara  daflnad  by 

Fl-kr»lR'l(BiKl+#2*i2>  *  f  12'k12-BXR*l(B2VrfiKI2> 
r2l“  **9a21  *  824"l<BiKI4*2Ki2)i’ 

F2-A2-82a*1(BiKJ+  uB^)  (31) 

VUY*l2-(?lCi>ua*YFl2Ci)V*lC2 

+(f'*VP2Cp+ul*yT(P1Cj 


*  u«*vp12c*)]v-1c2 


(32) 


Tha  resulting  aquations  fot  cha  new  varlablas  T). 
and  t)2  become  aftar  lengthy  manipulations:  1 

\  "  (yl*Fi2I>1>i*BlB*l(B2K2  +  ll8iK12)T,2 

+  u'VBjR'^B^Kj  ♦uB^j)  -  uTF12]ti2 
+{(P1C{+  ua"YPuCp-  uat'VMC(uP[2Ci+  u*‘VP2C^) 

+  a(W)T(PlCi+ua,'YPl2Ci)])v-lu0  (J3) 

uTI2-h2h2-Cb2r‘1(8^k2+  uB{Kj2)-  uTF12]H2 

.  Or  ,  n  i  —  #  .  ..Of-'Y,, 


a-y. 


T<Vi 

12CW\ 

(34) 

•  u:*vMn2) 

(33) 

wtiara  V(J  Is  daflnad  by 

...  d  _  -Y„ 


Tha  near-optimal  cwo  clma-scala  limiting  solution 
Is  obtainad  by  manipulating  cha  macrlcas  In  f33 )* 

(33)  and  neglacclng  cams  smallar  chan  O(u^). 
Afear  savaral  data  Had  manipulations  which  ara 
omlccad  Kara,  cha  resulting  approximate  filters- 
controllars  ara  glvan  by 


'1 


wtaara 
u0  -  uf4uf 


*,  +  O(u’) 

■  «j  ♦  O(u^) 

u*  •  u0  OCu1*) 

-  a*l(N'i.0+a'x0)5j 


,‘l»2*2SC 


(36) 

(37) 


Tha  slow  and  fasc  (Hears  ara  glvan  by 

i,'*oi.+#o“o+<poco4<;oHDo>vol[jf'co;s*  “‘Vo3  <38> 


uXjaAjSj+BjUj+u^0  \c±V  '■[yC^Xj-a 
whara 


•u*YS0Us] 

(39) 


-l, 


E0  *  *"*2*2 


B, 


2  (40) 

Moca  that  cha  slow  (Hear  and  concrol  ara  cha  saaa 
at  chosa  obtainad  by  solving  cha  raduced-order 
p rob  lam,  by  (ormally  sacclng  u  •  0  in  cha  lafe- 

aV 

hand  slda  o f  (9).  Tha  earns  j,  multiplying  E. 
and  C2  in  (38)-(39)  seam  from  our  dafinlclon 


•v 

of  y  by  multiplying  jr,  by  u  ,  consaquandy  this 
cam  doas  not  diverge  even  (or  y  >  0.  It  should  ba 
nocad  chat  cha  slow  (Hear  la  drlvan  by  eha  slow 
Innovations  only.  In  vlaw  of  [3]  eha  parformanea 
index  whan  uQ  Is  usad  is  within  0(u)  of  cha  optimal 

parformanea  lndax.  Tha  cwo  clma-scala  near-optimal 
sehaaa  glvan  by  (37)-(39)  la  shown  la  Fig.  1. 

V.  Discussion  and  Analysis 

In  this  taction  wa  analyte  tha  relationships 
beewaen  cha  scaling  parameter  exponancs  and  their 
effect  on  eha  various  variables  In  Cha  systems. 
First,  cha  parformanea  lndax  will  ba  flalea  If  cha 

expression  u^*cov(x2)  Is  finite.  Hanes,  In  vlaw  of 

(13),  wa  should  raqulre  chat  J  satisfy 

«*(%-«>  (41) 

Note,  Chat  this  imp  Has  full  weighting  to  cha  fast 
variable  only  whan  or  *  However,  as  discussed 
above,  eha  case  a  *  h  is  cha  only  ona  for  which  cha 
fate  variable  la  a  well-defined  process  In  cha  feat* 
claa  scale.  If  or  >  Y,  chan  from  (27b)  as  u  -  0* 
cha  covariance  of  cha  error  of  cha  fasc  variable 
tends  to  cha  covariance  of  cha  variable  itself, 
implying  chat  eha  (asc  variable  is  noc  observed  due 
co  cha  noisy  observations.  Hence,  (or  a  meaningful 
problem  wa  should  require  or  *  Y,  even  chough  a  >  Y 
causes  no  difficulties  except  for  eha  disappaaranca 
of  cha  observations  cams  in  (39),  as  it  -  0+.  For 
cha  case  a  ■  Y,  cha  fate  (Hear  (39)  formulation  Is 
quite  simplified  is  u  -  0*.  since  only  cha  fasc 
observation  channel  y2  remains ,  namely 

‘A*f’fc2*f+*2“f*P2C22v2  (42) 

v 2-{y2-c22*f •Cu<*c21-  *  c22a2  1a21]  ai-c22A2lB2ui ) 

whara  Cha  neglected  cam  may  ba  larger  chan  0(u^> 
but  is  negligible  wlch  respacc  co  cha  variance  of 
it.  Finally,  as  for  cha  parameter  B ,  cha  restric¬ 
tion  imposed  in  (14)  doas  noc  result  in  any  dif¬ 
ficulties,  however,  whan  3  >  a,  chan  cha  efface  of 
Che  slow  syscam  on  cha  fasc  is  negligible  as  u  -0  ♦, 
even  Chough  its  contribution  Is  sdll  larger  chan 
O(u’). 

v-_,  hmtu 

A  singularly  parcurbcd  scochaacic  linear 
control  problem  is  fomulaced  where  weighting 
parameters  as  powers  of  cha  perturbation  parameter 
ara  usad.  ic  is  saan  chac  if  chase  parataacers  ara 
restricted  eo  certain  raglons,  eha  resulting  con¬ 
trol  problam  Is  well-posed.  Tha  nose  significant 
parameter  value  is  a  which  for  a  •  0  yields  the  pre¬ 
viously  considered  ease  and  for  a  -  V  yields  a  well- 
defined  fast  variable.  These  two  excreme  values 
raprasanc  cha  extramas  of  parasitic  fasc  variables 
and  finlea  variance  meaningful  (asc  varlablas. 

Other  values  of  a  may  ba  usad  co  raprasanc  ochar 
cases  in  baevaan. 

Tha  formulation  may  ba  extended  co  multiple 
Clma-scalas  problems  with  more  than  ona  perturbaclon 
parameter  as  In  [3].  Furthermore  any  problam  in¬ 
volving  savaral  pareiclonad  blocks  of  variables 


f 


with  different  a,  3.  V,  5  for  each  subayscea, 
may  ba  solved  la  the  same  manner.  This  papar 
considered  only  a  single  taac  subsystem  for 
slaplicicy. 
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Control  of  Linear  Singularly  Perturbed  Systems 
with  Colored  Noise  Disturbance* 

HASSAN  K.  KHALILt 
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Brief  Paper 


Summary — This  paper  considers  the  stochastic  control  of  linear- 
quadratic  problems  for  singularly  perturbed  systems  when  the 
input  noise  is  colored.  A  near  optimal  linear  output  feedback 
control  is  obtained  by  optimizing  a  slow  subsystem  only. 

1.  Introduction 

Singular  perturbation  methods  are  physically  motivated  tools 
for  order  reduction,  separation  of  time  scales  and  other 
simplifications  in  control  system  analysis  and  design(l]. 
Recently  Haddad  and  Kokotovic  have  applied  the  singular 
perturbation  theory  to  the  stochastic  control  for  Linear- 
Quadratic-Gaussian  problems  for  systems  with  fast  and  stow 
modcs[2].  In  their  approach  both  the  input  noise  and  obser¬ 
vation  noise  processes  are  modeled  as  white  noise.  For  the  same 
problem.  Teneketzis  and  Sandell  have  developed  a  hierarchical 
control  design  method  to  reduce  the  on-line  computations^]. 
However,  singularly  perturbed  systems  incorporate  fast  dy¬ 
namics:  so  if  the  correlation  time  of  the  system  disturbances  is  not 
short  compared  to  the  small  times  of  interest  of  the  fast  modes, 
modeling  input  noise  as  white  is  not  appropriate,  and  does  not 
take  advantage  of  singular  perturbation  techniques.  As  an 
illustration  consider  a  circuit  with  parasitic  capacitors.  If  we 
model  the  input  noise  as  white  noise,  these  capacitors  are  not 
negligible  regardless  of  how  small  their  time  constants  are.  Thus 
whenever  the  correlation  time  of  the  input  noise  is  not  short 
compared  to  times  of  fast  modes  of  the  system,  it  should  be 
modeled  as  col'  id  noise.  Hence  in  this  paper  we  consider  the 
case  when  the  input  noise  is  colored.  Since  colored  noise  is 
modeled  as  the  output  of  a  system  driven  by  white  noise[4],  our 
problem  is  a  special  case  o(^2]  when  the  fast  modes  equations  are 
noise  free.  We  will  keep  the  assumption  that  observation  noise  is 
modeled  as  white  noise.  The  derivation  of  a  control  algorithm 
will  show  that  this  assumption  does  not  degrade  the  results. 

The  assumption  of  colored  input  noise,  or  equivalently  white 
input  noise  with  noise  free  fast  dynamics  equations,  will  enable  us 
to  give  a  clearer  presentation  of  the  problem.  We  avoid 
complications  of  the  more  general  problem,  such  as  ill-defined 
quadratic  performance  indices  in  the  limiting  procedure[2]. 
Moreover  we  get  an  explicit  result  iTheorem  1 )  which  cannot  be 
obtained  as  a  special  case  of  the  corresponding  result  of  [2].  Tne 
methodology  here  is  simpler  than  that  in  previous  treatments  of 
linear-quadratic  singularly  perturbed  systems.  We  approximate 
a  performance  index  directly,  thus  avoiding  consideration  of 
boundary  layers.  Moreover  the  solution  is  analogous  to  the 
compact  form  of  the  deterministic  case[5]. 

2.  Problem  statement 

Consider  the  singularly  perturbed  linear  system 

j-fli(rhnn<-fl,iri«i(n.  x,(t„)-x,0  m 

iix2ir  i»4;,ittX|(n-i-.],,iox!iii 

-vflj(r*ui*C.(M*|ifL  xj(r„i-x20  (2) 
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with  observation  equation 

y(r)«f  ,(r  Ix^rl-t-f  .(OXj(t)+w2(»(  (3) 

and  performance  index: 

HK9U.  rt)(::I., 

*i.CC;)(r£  ftfiXi)*"’*} 1,1 

where  dimensions  of  x,.  x2.  u.  y  and  v,  are  n.  m.  r.  1  and  s 
respectively,  u  is  a  sufficiently  small  positive  scalar,  and  v,(r)  is 
colored  noise  modeled  by 

*,(r)-H(nv,(fH-w1(rl,  vtUo)“*io  *5) 

w,(rl  and  w2(rl  are  zero  mean  white  Gaussian  noise  processes 
that  need  not  be  uncorrelated.  The  covariance  matrix  of  wit) 
-(wiUk  w2IMI  is 

/  y,m  v,  »i/A  . 

£  wlOw'(s)  »(  ‘  d(r-s).  16) 

\F12|t)  F2(r)/ 

Also.  x,0,  x20  and  *10  are  Gaussian  random  vectors  with  mean 
values  x,0.  x20  and  r,0  respectively.  There  may  be.  in  general, 
correlation  between  them,  but  each  of  them  is  uncorrelated  with 
>(M.  isjf0 1.  The  assumed  form  of  the  terminal  cost  in  (4)  is  usual 
in  the  treatment  of  singularly  perturbed  linear  quadratic 
problems[6],  A  more  general  case,  when  tiT,  2,  ftfz  are  replaced 
by  fi:-  respectively,  has  been  treated  in  [7],  It  results  in 
singularly  perturbed  problems  with  infinitely  large  boundary 
conditions. 

The  problem  is  to  determine  the  control  u|r)  as  a  function  of 
past  observation  | yts ).  i„gs<r|  which  minimizes  (4)  under  the 
following  conditions  for  re[r0,r,]: 

111  All  the  matrices  are  continuous,  bounded  and  have 
bounded  first  derivatives. 

|2)  f,  gO.  R(r)>0.  t'.(M>0. 

|3|  422(tl  is  a  stable  matrix  |Re!/.M22lf  l|  $  -a  for  some 

<T>0). 

Combining  |5)  with  (1).  (2).  (3).  and  |4t,  and  putting  x  *lx,.  v,  | 
and  i»x2.  we  obtain  the  augmented  system 

*(t)».4M(t)x(r)-)-4|2(t)z(r) 

-i-B,(t)olll-i-G,(l)Wi(t).  x(f„)-x„  l7l 

/ii(t)»/f2,(f)x(tH-.422«ll(t)-l-B2(»)«ltl.  z(tiil*Zo  (8) 

ytr)-C|(rlx(i)-*-C2lt  itirl  +  w.ul  t9) 


with  performance  index 


'-£C 


r,  /<f, 

pT\:  u  T. 


M... 


i  r"/x\7c,c,  c;c:yx  . 

'2  J,„W \QC,  C2C2A*. 
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We  define  the  reduced  problem,  formally  obtained  by  setting 
p**0  in  (7M10).  by 

*rIM-/40tf)x,(fl+Bo»»UI+GiU)*it'l.  x,(t0).x0  (i|, 

ylt )-  Colt  )x,(r)  +  D0U  mit)  +  »j(f  I  (12) 

with  performance  index 

if.  x,u/)+i  ji'  [x,qc0x, + :*  d0c<,x. 

+  a'(R  +  DoD0)»]<lt!  (13* 

where 

•4o"*Au  '  B0“B,  — 

C0“C,  -C2A22  A21,  0o*  — C2A22  fl2. 

3  Sear  optimal  linear  output  feedback  control 
A  transformation  due  to  Changes],  which  separates  the  fast 
and  slow  modes,  is 

Q-rr  -do 

where  M(M  and  Lit)  matnees  satisfy 

pL  —  A22L  —  A  21  —  pL(  Atl  —  Ai2L)  (151 

pM  »  -  W(A2i  +  |if.Ai;)+  <ij+U(Aii  -AxiL)M.  (161 

Since  the  initial  conditions  for  Lit  I  and  .VMM  are  arbitrary,  we 
choose  them  to  be 

L(r0(  — A22l('oM2i(t0)  (17) 

Vf(t0)  —  A|2('oM22  (r0).  (18) 

Applying  the  usual  singular  perturbation  lechniquesfl],  we 
obtain  for  all  re[r0,r,.] 

L(t)»  A22  AJt(t)+0(ji)  119) 

M(r)»/412(rM22‘(t>+00<).  (20) 

Then  (7),  (8)  and  (9)  becomes 

p(M-M„(M  +  0(pl)p(M  +  (flo<')+0(p))u(M 

-MG,(M+0(p))w1(o,  p(t0)-Po  (21) 

uq(r|-(A22(tl  +  0(u))q(t)  +  (B2(t)-t-0(>i))»(t) 

+pGilt)m,lr>,  q(r0)«q<,  (22) 

y(M  —  (C0(r)+0(p))p(M-HC2(M+0(pl)q(M+w2iM.  (23) 
Letting  ipt I  and  pit)  satisfy  the  equations 

q(t)«  A0(t)if(t) +  B0(t  (•(!)  + G^Mw^t), 

q(to)-ifo-Po  124) 

ppinmAuinpiii+Bjitkuti+pGjtnwxin 

Pl'ol-Fo-qo  <251 

it  can  be  easily  shown  that 

q(r)*p(t)-**0l|x)  (26) 

p(M-q(M+0(p).  (27) 

Since  A . .  ft  l  is  a  stable  matrix  for  all  t  e  [r0.  tr].  using  Lemma  2  of 
[9]  it  follows  that  pit)  has  bounded  covariance  as  p  —  0.  Then 
from  1 14),  |26)  and  1 27)  we  have 

xlM-qlt>+0(p)  (28) 

I(M-  -  422  (nA2,|MqlM  +  pin-i-0(p).  1 29) 


Lemma  I.  As  an  input  to  slow  linear  systems.  /Hr  I  can  be 
approximated  to  0<p)  by 

-  AtVuiBjUM'h 

for  all  re[t0,t/],  that  is 

Pit  Id'  -jV.  [  -  A 22‘  it  I B2U  m<M]dt  *0ip i, 

t,  s[t0+£,t/]  (30 1 

for  some  fixed  e>0. 

Proof.  From  125)  and  Lemma  2  of  [9],  we  have 

pIM-exp^Ajjlto^^-^yjpo 

+ij;,e*p[A2Jl<M('-^)] 
x[B;|cr)ii,<n-t-pG;.(<Mw,|<n]d<r-t-0(p).  (31 ) 

It  can  be  shown,  by  reversing  the  order  of  integration,  that 

j;;/ht)dt-2i  | expj^4j2n0)(^-~^jj-/j-.42‘21('0)p0 

+pj;;|exp^.2(<r^^jj-f| 
x  Aii  (o)G2(e)w,(iT)diT 


+}':;e*pJ^A22(ix)  (*?)]  AfJ  (<T)B;l<T)U|tT  M<T 

-f;;A2-2'(<T)B2(nW<rld<r+0(p) 

»  -f!;A22'lMB2(MuU)dr+0(p), 

for  all  f,e[r0  +£.!/].  (32) 


Lemma  2. 

d»Jj+0(p)  (331 

where 

h  “  Elif  'l tr  ITxiU, )  +  *|!'  [q'QCoq 

+  2u'DiC0g  +  u  (R  +  f>iD0)u]dt!.  |34) 


Proof.  It  follows  from  (29)  and  (30).  that  for  an  olp I 
approximation  of  J  the  quantity 


-A2‘2'(')A2l(Mq(I)-.4j'2‘(nB2(M«(M  (35) 

can  be  used  instead  of  i  in  (10).  Then,  using  (28)  and  (35).  (10) 
reduces  to 


We  define 


J<-Js  +  0lp). 


y1<M»Cn(tHf(M~f>0(nutM-i-w2|r).  l36> 

Lemma  3.  As  an  input  to  slow  linear  systems  yin  can  be 
approximated  to  otpl  by  y,(M  for  all  ie[t0.rf],  that  is 

|';;yir)dt-)';;yi(Mdr+0ipl.  t,  6 [t„  +  r.. t f]  (37) 

for  some  fixed  t.  >  0. 


Proof.  From  1 23).  we  have 

y  (Mdr »/,';[( C0 1 M -i- Olp )  )p(  M 

■HC.  in +  0(p))qtM  +  Wj(njdr 
-f;;[C„(np(M-t-C2<nqin  +  w2(M]df  +0(pi  1 38) 
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since  pit )  and  q(r )  have  bounded  covariances  as  p— 0.  Using  (26). 
(27),  and  Lemma  1.  (3$)  becomes 

)';^(f)dr  -  fi;[Co(i  M* )+  OoU  )■(»!+ W,(»  )]dr + 0(#i ). 

Theorem  1.  The  solution  o(  the  stochastic  linear  quadratic 
problem  for  the  singularly  perturbed  system  defined  in  (7H 10). 
can  be  replaced  to  an  o(ji)  approximation  in  J.  by  the  solution  of 
the  stochastic  linear  quadratic  problem  for  the  reduced  problem 
defined  in  (I1H13), 

Proof.  From  Lemma  2,  we  know  that,  to  an  olp)  error,  the 
minimization  of  J  reduces  to  the  minimization  of  Js  with  respect 
to  (24).  Assuming  that  y,(r)  is  available  for  measurement,  (24), 
(36)  and  (34)  define  a  stochastic  linear  quadratic  problem  for  the 
slow  variable  g<(L  whose  solution  is  given  in  [4],  Since  in  that 
solution  y,  (r)  is  used  as  an  input  to  a  slow  filter,  from  Lemma  3. 
y,(r)  can  be  replaced  by  y(t)  giving  an  041)  error  in  the  estimate 
i (t ).  An  o{p )  error  in  g(r )  gives  an  0  (/a)  error  in  J .  When  y ,  (t )  is 
replaced  by  yuL  the  solution  of  this  problem  is  identical  to  the 
solution  of  the  reduced  problem  defined  in  (11 H 13).  This  can  be 
seen  by  comparing  ill).  (12)  and  (13)  to  (24),  (36)  and  (34) 
respectively  with  xr  replaced  by  g. 

Remark  1.  Theorem  I,  besides  establishing  the  main  result  for 
systems  with  colored  noise  inputs,  is  also  true  for  systems  with 
white  noise  inputs  when  the  noise  does  not  appear  in  the 
equations  of  the  fast  variables,  that  is  when  the  system  equations 
takes  the  form  of  the  augmented  system  defined  in  (7H9). 

Thus  from  Theorem  1  and  [4],  we  obtain  the  near  optimal 
linear  output  feedback  control 

u--(R-f-D„D0)  1  (  DqCq  +■  B'qS  lx*,  r€[to,ry]  (39) 
where  iV(r)  is  the  solution  of  the  matrix  Riccati  equation 
S  —  —  (V(  Ao  ~  Bq(R  +  D0Dq  )  [  DfjC  0) 

-  Mo  -  B„(R  +  D-0D0 )- 1  DiC,  f.V 

+  NB0lR  +  D„D0r'B’0N 

—  (C(jCo  — CqDq[R  +  D0Dq )  lD<,C„)  (40) 

with  terminal  condition  Nft, )  -  T, .  and  x,  is  the  optimal  observer 
given  by 

x, -A„(t)x, -t-80(rHi(r) 

t-K(r)[yin-Co(r)xr(i)-D0(r)u(n],  rs[t0.t/]  (41) 
with  initial  condition  xrlt0)-£[x(t0)]  =  x<),  where 

/CiM»[AinCiir)-i-C,(r)l/1,(r)])',"l(r),  re[(0,rfj  (42) 
and  Alt)  is  the  solution  of  the  matrix  Riccati  equation 

A-IA0-C,F,j)'2-1C„)A  +  A(.40-GiF1j)'j-,C0)' 

-acqKj-'CoA  +  g,f,g;  -g.v.jFj-'f.jG;  (43) 
with  initial  condition  \(r„ )  -  -£;  fx0  -  x0Hx0  -  x0)'!. 


4.  Realization  of  the  control  algorithm 
A  realization  of  the  near  optimal  control  algorithm  is  given  in 
terms  of  the  matrices  of  the  original  system  defined  in  II)- 1 5). 
Let 


.V-(V«  H 

'.V,  sj 

A  ,(A' 

\a;  a,/ 

^1  2^22  ^21  ■ 

3o  2^2  2*  ^2 

-  ^i2^22'^2 

^*0-^1  ^2-^22*  ^21 

&q  m  “  £2^12  ^2* 

£0  “  “*^2^22l^2« 

•kl  "A, <T0  a-Ajfo*  *1*  l  *  AjCo -r  A)E’o. 


FiC.  1. 


Then  the  near  optimal  linear  control  is  given  by 

U-IB  +  Dq&o  )  '[(fi„£„  +  floAf  I  1*1  +(/>„£„  E'qN  2  )V[  ] 

(44) 

where  X|  and  v,  are  given  by  the  filters 

“40X|  +G0»i  +A0«  +  il'i  Ff 1  (y  —  c0x,  -£0v,  -D0u). 

ii(to)”*io  (45) 

i,  -Hv,  -Hgfj  +  ku)  k’j-'iy-CoX,  -£0v,  -&„■). 

*i(to)“*io-  <461 


5.  Example 

A  familiar  example  in  singular  perturbation  literature  is  the 
speed  control  of  a  dc  motor  We  suppose  that  the  motor  is 
disturbed  by  a  stochastically  varying  torque  operating  on  its 
shaft.  For  a  tyH.cal  dc  motor  characteristics  [10.  pp.  12-14]  the 
state  equations  are 

« lKiJ\Xi  +  (l<J)wl  147) 

jixj  m  -|C  RTm)x,  -  (1  Tm)x2  +  (1  RTm)u  (48) 

where  xt.  x2.  and  u  are  speed,  current,  and  voltage  deviations 
from  their  respective  nominal  values  "M2  rad,  s.  0.75  A.  27  V.  and 
w,  is  the  disturbing  torque.  The  motor  constants  are  R  =  16Q.  C 
-0.02  V  S/rad.  J  - 10"‘  Kgm*.  The  small  parameter  u  =■  T,  T„ 
where 

Tr  -electrical  time  constant » LR 
and 

T„  »  mechanical  time  constant  -JR  CK. 

Scaling  the  time  in  |47)  and  (48)  so  that  its  unit  is  ms.  our 
stochastic  problem  is  given  by 

x,  -  20tj  +  lOV,  l49i 

lix2-  -3  125  x  I0  !x,  -25  x  I0‘ Jx,  +  1.5625  x  10->ui50) 

rn  m 

V-  „  x,  *  „  I X 2  4" W 2 

LoJ  L80j 

|jlT1  — ! — (jef  +  6400x;  +  25u,tdi; 

2,,-,  (t,-r0l 


(52) 
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Table  1 


V 

8 

X 

10-' 

19.48375 

0.432824 

2.22146 

10-' 

14.58385 

0.02166 

0.14852 

10- 5 

13.8648 

0.0017 

0.01226 

10-* 

13.787885 

0.000119 

0.00086 

where  w,  and  w2  are  uncorrelated  zero  mena  white  Gaussian 
noise  processes  with 


K,-4x  10'*, 


This  is  a  realistic  example  of  the  special  case  of  Remark  1.  and  is 
used  to  illustrate  Theorem  1.  We  compare  the  performance  index 
J  resulting  from  applying  Theorem  1  with  the  optimal 
performance  index  resulting  from  applying  the  exact  control 
for  different  values  olu-  The  results  are  shown  in  Table  1. 


6.  Conclusions 

We  have  applied  the  singular  perturbation  theory  to  the 
stochastic  control  for  Linear-Quadratic-Gauss lan  problems  for 
systems  with  fast  and  slow  modes.  The  input  noise  has  been 
modeled  as  colored  noise  and  the  observation  noise  as  white 
noise.  Our  treatment  incorporates  another  important  problem  in 
which  the  input  noise  is  white  but  the  fast  dynamic  equations  are 
noise  free.  In  the  resulting  control  algorithm,  the  output 
measurement  y(r)  is  used  as  an  input  to  a  slow  filter  only.  No 
filtering  of  fast  variables  is  required.  This  permitted  the  modeling 
of  the  observation  noise  as  white  noise.  As  an  illustration,  in 
determining  the  required  speed  of  response  of  the  measuring 
instruments  only  slow  variables  are  of  impottance.  With  respect 
to  such  low  pass  instruments,  it  is  justified  to  model  the 
observation  noise  as  white  noise.  The  assumption  of  colored 
input  noise  and  white  observation  noise  is  thus  consistent  with 
the  separation  of  time  scales  in  singularly  perturbed  systems. 

The  main  result  of  this  paper  (Theorem  1)  is  that  the  optimal 
solution  of  the  stochastic  control  problem  can  be  approximated 
by  the  optimal  solution  of  the  reduced  problem.  This  leads  to 
saving  in  both  on-line  and  off-line  computations.  Moreover,  the 
Riccati  equations  that  are  solved  are  better  conditioned  than  the 
equations  of  the  original  problem.  It  is  significant  that  the 
approximate  control  does  not  require  the  knowledge  of  the  value 
of  the  singular  perturbation  parameter  n.  Hence  this  control 


algorithm  is  applicable  to  systems  where  n  represents  small 
uncertain  parameters.  The  approach  in  this  paper  differs  from  [2] 
in  that  it  represents  a  direct  generalization  of  the  deterministic 
problem  [5]  and  preserves  its  form.  It  is  important  to  notice  that 
Theorem  1  cannot  be  obtained  as  a  special  case  of  Theorem  2  of 
[2]  unless  an  additional  assumption  is  made  that  the  fast 
variables  are  of  little  interest,  that  is 

c2»o(/i'')  and  fj-o(*ii:). 

Another  advantage  of  this  approach  is  that  no  familiarity  with 
the  singular  perturbation  literature  is  required.  Only  the 
standard  facts  of  the  Linear-Quadratic-Gaussian  problems  are 
needed. 
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I.  Introduction 


T  IS  COMMON  in  systems  with  several  decision 
makers  that  the  decision  makers  assume  different  sim¬ 
plified  models  of  the  same  system.  As  a  consequence,  even 
if  decision  makers  have  the  same  overall  goal,  their  indi¬ 
vidual  objective  functionals  may  have  different  analytical 
expressions.  Thus,  large  scale  system  problems  should,  in 
general,  be  characterized  by  multiple  decision  makers 
having  different  models,  different  information  sets,  and 
different  objective  functionals. 

This  multimodel  situation  is  illustrated  by  a  multi-area 
power  system.  The  decision  maker  in  an  area  employs  a 
detailed  model  of  his  area  only  and  a  “dynamic  equiv¬ 
alent"  of  the  remainder  of  the  system.  Other  decision 
makers  behave  similarly  in  their  own  areas.  Thus,  the 
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same  power  system  appears  in  different  forms  to  different 
decision  makers.  Present  power  system  practice  suggests 
that  even  if  the  decision  makers  were  given  a  complete 
model  of  the  system,  they  would  still  use  different  sim¬ 
plified  models  to  match  their  individual  needs. 

In  this  paper  singular  perturbations  [1],  [2]  are  em¬ 
ployed  to  capture  the  multimodel  nature  of  intercon¬ 
nected  systems  with  slow  and  fast  dynamics.  We  consider 
systems  strongly  coupled  through  their  slow  parts  and 
weakly  coupled  through  their  fast  parts.  In  [3]  such  sys¬ 
tems  have  been  treated  from  a  periodic  coordination  point 
of  view.  For  this  class  of  systems  a  new  multiparameter 
perturbation  method  is  developed  and  used  in  the  design 
of  regulators  and  Pareto  strategies.  It  is  illustrated  by  a 
load-frequency  control  problem  for  a  two-area  power 
system. 

II.  A  Multimodel  Representation 

A  linear  system  consisting  of  strongly  coupled  slow 
subsystems  and  weakly  coupled  fast  subsystems  is  mod¬ 
eled  by 

N  N 

X-A.X+  2  *4*;+  2  B*up  *(0)-JC„  (la) 
/-■  i- I 

Sli,-Aiex  +  AllZi+  2  S.y'Vy +  *«“'•  *.(°) " z» 

j+> 

(lb) 
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where  dim*  — /»„,  dimzf-/i(,  dim u, - m(,  /'-l,-  •  •  ,N.  The 
small  singular  perturbation  parameters  S,  >  0,  one  per 
subsystem,  represent  time  constants,  inertias,  masses  etc., 
while  the  small  regular  perturbation  parameters  Stf,  i+j, 
represent  weak  coupling  between  the  subsystems.  The 
states  z,  are  “fast”  since  their  derivatives  z,  are  of  order 
1  /$,  which  are  large. 

Linearized  models  of  many  real  systems  appear  in  this 
form.  A  well  documented  case  is  the  load-frequency  con¬ 
trol  of  a  two-area  power  system  in  which  each  area  is 
represented  by  one  steam  plant  A  model  of  such  a  system 
based  on  [4],  [5]  is  given  in  Appendix  A.  It  is  apparent 
from  this  model  that  the  time  constants  of  the  speed 
governor  and  the  turbine  are  much  smaller  than  the  time 
constants  of  the  system  inertia  and  the  integral  control. 
Hence,  we  select  the  ratios  of  small  versus  large  time 
constants  as  the  singular  perturbation  parameters  S,  and 
®2> 

c-  max(  Ta,  Tti )  /<%v 

©i  - - - •  (2) 

We  then  substitute  To,  and  Th  in  terms  of  S,  and  identify 

x'-(c„c2, A/lA/lAp, 2)  (3a) 

as  the  slow  states,  and 

4"(4p<w*Aq,),  1-1,2  (3b) 

as  the  fast  states.  Then,  taking  into  account  that  the 
controls  act  upon  speed  changers,  ui"‘tkpCi,  we  obtain  the 
model  in  the  form  of  (1),  where  the  subsystems  are  uncou¬ 
pled,  5V  -0. 

Let  us  now  assume  that  the  decision  maker  of  the  kth 
subsystem  neglects  the  weak  coupling  parameters  and  the 
fast  dynamics  of  all  other  subsystems,  but  retains  the 
exact  model  of  his  own  subsystem.  In  the  model  (1)  this 
simplification  is  equivalent  to  the  assumption  that  Sj  -0, 
j¥>k,  and  0,  that  is  to 

N  N 

x*-A0xk+  2  -V>+  2  BojUj  (4a) 

y-i  J- 1 

S*  i*  -  A*. xk  +  Auzk  +  (4b) 

0 *  Ate  x* + Auz,  +  Bu  u,,  i  *  k,  i  - 1 ,  •  •  • ,  N. 

Now,  if  Au  are  nonsingular,  the  substitution  of 

+  £„«,),  /*k,i-l,---,JV  (5) 

into  (4)  results  in  the  kth  simplified  model 

XkmAkxi  +  Aokzk  +  B<*uk  +  2  B^uj  (6a) 

j+k 

®*4"Atox*  + Attz*  +  (6b) 

where 

A*  "  A0  —  2  AgfAjj  'Aj,,  Bkjm  By  —  A^Ay  lBy. 

J+k 


We  point  out  that  this  “kth  model  simplification”  is 
achieved  by  the  “kth  parameter  perturbation,”  that  is, 
when  the  only  parameter  assumed  to  be  different  from 
zero  is  Sk.  In  our  power  system  example  the  first  per¬ 
turbation  (k-1)  means  that  the  decision  maker  of  the 
Area  1  neglects  the  small  time  constants  of  the  Area  2, 
and  the  second  perturbation  (k-2)  means  that  the  deci¬ 
sion  maker  of  the  Area  2  neglects  the  small  time  constants 
of  the  Area  1.  If  there  were  interactions  among  the  fast 
subsystems,  they  would  have  been  neglected  by  both 
decision  makers. 

III.  The  Design  Problem 

In  the  above  presentation  we  have  viewed  the  model  (6) 
as  a  result  of  an  intentional  model  simplification,  that  is 
as  if  the  original  model  (1)  had  been  available  to  all 
decision  makers.  We  now  make  a  more  realistic  assump¬ 
tion  that 

each  decision  maker  knows  only  his  ... 

simplified  model  (6).  '  ' 

The  earlier  interpretation  remains  valid  as  a  description  of 
the  relationship  between  the  original  model  (1)  and  its 
simplifications  (6),  but  need  not  imply  the  decision 
maker’s  knowledge  of  the  original  model. 

The  main  purpose  of  this  paper  is  to  analyze  the  impact 
of  such  multimodel  assumptions  on  the  design  of  control 
strategies.  We  consider  that  the  kth  decision  maker  will 
base  the  design  of  his  control  strategy  on  the  kth  model 
(6)  to  meet  his  set  of  design  specifications.  To  be  specific 
let  the  design  specifications  of  the  kth  decision  maker  be 
expressed  in  terms  of  a  cost  functional  Jk—Jk(x,zk,uk). 
The  cost  functional  Jt  of  the  ith  decision  maker  is  known 
to  the  kth  decision  maker  in  the  form  since  the  z, 

variable  does  not  appear  in  his  model  (6).  For  the  well- 
gpscdness  of  this  design  problem  it  is  assumed  that 
is  consistent  with  /,(x,z,,u()  in  the  sense  that  it 
can  be  obtained  from  Ji  using  (5).  The  kth  decision  maker 
problem  is  characterized  by  (6)  and  the  cost  functionals 

hm*k{x,zk,uk),  4 -4 (*•“().  ts*k, i-l,- •  •  ,N. 

(8) 

It  will  be  viewed  as  a  perturbation  of  an  original  problem 
characterized  by  (1)  and  the  cost  functionals 

4  “4  (*•**.“*).  k  —  !,•  ••  ,N.  (9) 

This  original  problem  will  be  helpful  in  the  analysis  of  the 
impact  of  the  multimodel  situation  on  the  design  of  Pareto 
optimal  strategies. 

Motivated  by  the  single-parameter  singular  perturba¬ 
tion  approach,  we  propose  that  each  decision  maker  will 
use  the  two-time-scale  design  method  [1].  He  would  then 
have  to  solve  two  separate  subproblems  for  the  fast  and 
slow  subsystems  of  (6). 

In  the  fast  time  scale  rk  -  t/Sk  he  would  have  to  design 
a  fast  control  ukf  for  the  fast  subsystem 
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~7~~  m  Akkzkf  +  &kkUk/  (10) 

subject  to  the  initial  condition 

*v(0)™,*»‘*’^**'('^  Bkkuki(Q))-  (11) 

Since  the  fast  subsystem  (10)  is  completely  uncoupled 
from  other  states  and  controls,  the  design  of  can  be 
approached  by  each  decision  maker  as  a  separate  state 
regulator  problem. 

In  the  slow  time  scale,  the  slow  subproblem  of  the  *th 
decision  maker  is  obtained  by  setting  Sk  — 0  in  (6)  and 
using  (5)  to  eliminate  zk  from  (6)  and  from  the  cost 
functional  Jk.  The  relationship  between  the  simplified 
model  (6)  and  the  original  model  (1)  is  such  that  setting 
£*  -0  in  (6)  is  equivalent  to  neglecting  all  the  perturba¬ 
tion  parameters  in  (1).  Together  with  the  assumption  that 
J,(x,u,)  is  consistent  with  this  implies  the  ex¬ 

istence  of  a  common  slow  problem  for  all  decision 
makers. 

The  reduced  order  model  for  the  slow  state  x„ 

N 

*,mA, x,+  2  £*.«*,,  x,(0)-xo  (12) 

*-i 

where 

N 

AtmAt~  2  AotAu  lAio,  Bj^  —  8^  —  At^eAtt  'Bu 

i-i 

involves  all  the  slow  controls  and  thus  the  slow  prob¬ 
lem  has  to  be  solved  as  a  problem  with  multiple  decision 
makers.  To  summarize,  the  design  problem  is  approxi¬ 
mately  decomposed  into  N  fast  subsystem  regulator  prob¬ 
lems  and  a  slow  game  type  problem. 

Let  us  assume  for  the  moment  that  all  these  subprob¬ 
lems  have  been  solved  and  that  as  a  result  we  know  the 
feedback  matrices  in 

ukimGk ,x,,  ukf~Gkfzkf,  km\,'  •  ■  ,N.  (13) 

According  to  the  two-time  scale  method  [1]  the  control 
law  of  the  *th  decision  maker  using  the  feedback  matrices 
G/u’  Gy  will  be  composed  as  follows 

“t  ■  [(/  +  GitfAOk'Bu  )Gkl  +  GkfAu'Ako]x+  Gkfzk.  04) 

At  this  point,  this  control  law  is  an  ad  hoc  transplant  of 
an  earlier  state  regulator  result  into  the  new  multimodel 
environment.  Our  task  is  now  to  study  the  properties  of 
the  actual  system  (1)  controlled  by  the  control  law  (14). 
For  this  purpose  we  analyze  the  relationship  between  the 
response  x(r),  zk(i)  of  the  actual  system  and  the  response 
*,(/),  zkf(t)  of  the  designed  subsystems. 


IV.  Multiparameter  Perturbations 

When  the  proposed  control  law  (14)  is  applied  to  the 
actual  system  (1)  the  resulting  feedback  system  is 


x  — 


A.+  i  {M'+ViT'SaK 

I-  I 


+  BjGffAy  'Ate} 


x+  2  (A*  +  B9tGv)zt  (15a) 
<•1 


S1i1«(A||  +  S||G]y)A|1l(A|<)  +  B||Gi,)x 

^  i.A  1 1  ^  i  G\j  )z  |  +  SyA  12^2  (15b) 

62^2"*  (A  22  +  B-gGy  )A  a 1  ( A  It  +  B-ffi-y  )x 

+  64^21^1 + (An+  BnGy  )z2  (15c) 

where,  without  loss  of  generality  we  consider  the  case  of 
only  two  decision  makers  (*-l,  2)  and  denote  Sl2“Sj, 
S„-S4.  In  this  system  there  are  four  perturbation 
parameters  which  are  now  ordered  as  components  of  a 
vector  £  in  a  set  H  of  R*.  The  coupling  parameters  £3, 
£«  can  be  positive,  negative  or  zero,  while  the  singular 
perturbation  parameters  £,,  &2  are  striedy  positive.  Sys¬ 
tems  of  the  type  (15)  have  been  investigated  in  [6]  under 
the  additional  assumption  that  in  the  limit,  as  the  norm 
US  1|— *0,  we  have  either  £,/£2-*0  or  £2/£|-*0-  Since, 
under  this  assumption,  one  of  the  fast  subsystems  is  much 
faster  than  the  other,  this  problem  is  treated  by  two  nested 
single  parameter  perturbations  and  is  referred  to  as  the 
multitime  scale  problem.  Therefore,  if  it  is  known  that 
£,«£2  <>r  then  the  existing  multi-time  scale  re¬ 

sults  can  be  used  to  analyze  (15).  We  now  consider  the 
new  problem  when  S,  and  £2  are  of  the  same  order  of 
magnitude,  that  is  when  their  ratio  is  bounded  by  somt 
positive  constants  m  and  M, 

£, 

(16) 


Thus,  the  set  H  to  which  we  restrict  the  possible  values  of 
£  is  a  cylinder  in  R 4  whose  base  is  a  conical  sector  in  R  2. 
In  contrast  to  the  multitime  scale  problem  we  call  this 
case  the  multiparameter  problem.  Our  power  system  ex¬ 
ample  is  an  illustration  of  this  new  problem  since  the 
small  parameters  of  Area  1  are  of  the  same  order  as  those 
of  Area  2.  In  many  other  situations  the  subsystems  have 
similar  speeds  and  do  not  allow  the  multitime  scale 
assumption. 

We  are  now  interested  in  predicting  the  behavior  of  the 
actual  system  (IS)  for  all  small  values  of  £  in  H.  We  base 
this  prediction  on  our  knowledge  of  the  slow  response 
x,(t)  and  the  fast  response  zxf(t/Sx),  Zy{t/S2)  of  the 
subproblems  in  the  preceding  section. 

Theorem  1:  If  uxf—  GXfzXJ  and  uv-  Gvzv  are  designed 
to  stabilize  the  fast  subsystems  (10),  that  is  if 


ReX(Aw  +  5uGv)<0,  *-1,2;  (17) 

then,  for  every  finite  T>0,  there  exists  a  positive  scalar  o 
such  that 


*(0-*,(0+0(||£||)  (18a) 

zI(f)--/l1V(Au  +  RnG1J)x,(f)-tTl/(//SI)-t-0(||£tl) 

(18b) 


ziO)~  ~ A^iA^-t  B22G2l)xt+ *y(*/®:t)+0(ll®  II) 

(18c) 

hold  for  all  0 <t<T  and  ail  £  6 H,  0<||£||<o.  If  in 
addition  uu  »  Gux,  and  -  G^x,  stabilize  the  slow  sub¬ 
system  (12),  that  is  if 

Rex|^,+  2  (19) 

then  (18)  hold  for  all  t  e[0,  oo). 

Remark  In  other  words  this  theorem  claims  that  on  the 
respective  intervals  of  t  the  expressions  (18)  provide  a 
uniform  approximation  of  x(t\  z,(t),  and  z-ft)  as  £  -*0 
along  any  trajectory  in  H. 

Proof:  We  first  transform  (15)  into  the  separate  slow 
and  fast  parts 

y-Ej  (20a) 

Si  6|  •  £iO|  +  [  S3A 12+ Si  Lx  (A0 2 + Bt2Gy )  ]  o2  (20b) 

G\f )  ]»i  +  (20c) 

where 

E.~A.+  2  {*„(/+ 

+  BatGlfAu  'Ato—iA^  +  B^Gy)!*,}, 


E k  ”  ('*kk  +  El*  Gkf  )  +  &kLk  (A^  -rB^Gy),  *“1,2. 

The  transformation  used  is 


■ 

2 

• 

y 

I a  —  2  £,*/,/,  — £jA/i  —S2M2 

<•1 

X 

®i 

E\  I\  0 

*\ 

®2 

■  n 

-r 

0 

_ 1 

Z2 

(21) 


where  I,,  /„  and  I2  are  the  identity  matrices  of  the 
appropriate  dimensions  and  L„  Lv  Mx,  and  M2  satisfy  the 
matrix  algebraic  equations 


E\  *(^  1 1 +  G\f  )^m  ~  {A  1 1 +  B\ l  M  ii 1  (A  i«  +  ) 

-  S(  L|£0  +  Sj/t  i2^“0  (22a) 
El  *( A 22  +  B22 Gy  ) Lj  —  (A  22  +  ^22 &!/  )A a 1  (A if  +  B^ Git ) 
“  &iEiEt  +  &4A2lLf — 0  (22b) 


(/<i,  +  a 
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P j*  Af,£,  +  £2  M2Ei  (A0\  +  B0lGy)—(Afl  +  BrXGy) 

-S,£tfM,  +  S4M2^2i-0  (22c) 

P* 38  M2E2 +  SxMlLl  (A0 2 + Bo2Gy )  -  (Ao2+ Bt2Gv) 

-SiE'Mi+SjMiAu-O.  (22d) 

When  bounded  Lx,  Lj,  Af„  exist  the  transformation 
(21)  is  obviously  nonsingular  for  all  £  in  a  sphere  around 
£  “0.  The  existence  and  differentiability  of  Lu  L*  Mu 
M2  with  respect  to  £  is  established  as  follows.  First  note 
that  in  view  of  (17)  the  unique  solution  of  (22)  at  £  —0  is 

i*(0)-^'(/f*,+£**Gto),  *-1,2  (23a) 

Mk  (0)  -  (A* + B«  Gv  )(^tt + Gv  )~ ',  *-1,2. 

(23b) 


Then  consider  the  operator  PiL^L^M^M^S)  whose 
components  are  Px,  P2,  P2,  PA.  This  operator  is  analytic  in 
all  of  its  arguments.  At  £  -0  its  partial  derivatives,  with 
respect  to  L„  Af,  and  L*  M2  are  (i4„  +  ff„Gv)  and 
(/f  22+  BnGy ),  respectively.  They  are  invertible  because  of 
(17).  Thus,  by  the  implicit  function  theorem,  Lt,  L&  Mu 
and  Af;  are  analytic  in  £  at  £  -0.  Using  this  result  the 
matrices  and  the  initial  conditions  of  die  transformed 
system  (20)  are  uniformly  approximated  by  the  matrices 
and  initial  conditions  of  the  subproblems  (10),  (12)  in  the 
preceding  section,  that  is, 

ym[A,  +  BuGtj  +  B^Gj,  +0(||£  ||)].y, 

,(0)— *.+0(||£||)  (24a) 

£)d,-[(^l,  +  ff„Gv)+0(||£||)]o1+0(||£  UK 

o, (0)- z„  +  VM..+ BuGu )xe +0(||£ ||)  (24b) 

®2®2“®(ll®  II)®1  +  [(^22  +  £22^2/)  +  ®(ll®  H)]®J* 

vi(0 )-Su+AZ'(Au  +  £22^2,  K+0(||£  ||).  (24c) 

The  uniform  convergence  y(t)-*x,(t)  as  ||£||-*0  im¬ 
mediately  follows  from  the  continuous  dependence  of 
(24a)  on  its  right  hand  side  and  the  initial  conditions.  To 
prove  the  convergence  of  the  fast  variables  we  introduce  a 
joint  fast  time  scale  r- f/ *nd  obtain 


„G„)+0(||£||) 


(25) 


0(11  S II) 
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where  o,(<)*6j(tX  o^/)- 62(t).  The  limit  ||S ||-*0  ex¬ 
pends  every  finite  /-interval  to  infinity  in  the  r-scale,  a 
characteristic  of  the  “stretched”  time  scales  in  most  singu¬ 
lar  perturbation  problems  [6].  For  infinite  intervals  tE 
(0,oo)  the  stability  property  (17)  and  the  bounds  (16)  on 
S./Sj,  &2/S ,,  guarantee  the  uniform  convergence  o,(r) 
-»»io(t).  v^r)-*v^r),  where  o10(r),  u^fr)  are  the  solu¬ 
tions  of 


®!o(0) m  *io  "*■  ^  1 1  '(^  i«  +  -®i  i  (26a) 

^a+512C2/)®2o(T)> 

<ho(0)m  *2o  ^"A^^Ajg  (26b) 

Now  the  nonsingular  rescaling  of  r  into  r,  and  r2 

and  the  comparison  with  (10)  and  (11)  shows  that 

«io(*)-MTi)’  (27a) 

S»(t)-*v(t2).  (27b) 

Using  the  inverse  transformation  of  (21) 

x  lt  S,M,  &2M2  y 

/|  •  ™ JL|  / —  S2L|3^2  t?i 
Z2  —  L2  —  — Oj 

(28) 

proves  (18). 

As  a  simple  application  of  Theorem  1  consider  the 
pole-placement  design  of  the  load-frequency  control  in 
Appendix  B.  Each  area  designs  its  controller  matrix  <?*,  to 
place  the  fast  eigenvalues.  The  slow  eigenvalues  are  placed 
by  the  centralized  design  of  G,„  G^. 

V.  Pareto  Optimal  Strategy 

We  consider  the  situation  in  which  decision  makers 
decide  on  their  strategies  through  mutual  cooperation. 
The  solution  of  such  problems  is  found  in  the  class  of 
Pareto  optimal  strategies  [7],  the  essence  of  which  is  that 
no  variation  from  a  Pareto  optimal  strategy  can  decrease 
the  costs  of  both  decision  makers.  Let  each  decision 
maker  have  a  quadratic  cost  functional 

Jkm\  j["W*  +  ^Rkuk)dt,  R„  >0  (29) 


.V*  "  C*** + Cwzt.  (30) 

A  Pareto  solution  is  a  pair  u„  u2  which  minimizes 

•J-riJi+y*!*  0<y*<i,  yi+y2*i  (31) 

for  some  Yi  and  y2.  The  optimal  state  regulator  is  a  special 
case  of  this  problem  when  the  decision  makers  agree  on  a 
choice  of  Yi  and  yj  as  weighting  factors. 

The  specific  form  of  the  subproblems  of  Section  III  is 
as  follows.  The  slow  subproblem  is  characterized  by  (12) 
and  the  cost  functional 


A-Vu+Yj/j, 


where 


J*mffg  "(*»' CiC*,*, + lu^D^C^x,  +  u'^R^uJdl, 

Q*  ■■  Q*  —  C^A^'A^,  Dfr  m  —  C^A^B^, 

RumRk+ At»  Ak>-  (3 


Its  solution  is 


%.~v(aw,+i«w)*  (*) 

where  K,  is  the  positive  semidefinite  stabilizing  solution  of 
the  Riccati  equation 

K,A,+A,K,+ 

i»  t  n 

+  Y ,c;(/-  D„RJ X)C„  -o  (35) 


A, -A,-  2  B^R-'D^Ci,. 

/-i 

Denoting  B,»(Blt  B^)  and  C/-(C|,  Q,),  a  necessary 
and  sufficient  condition  [1]  for  the  existence  and  unique¬ 
ness  of  K,  is  that 

(A,,  B„  C, )  is  stabilizable-detectable.  (36) 

This  condition  does  not  depend  on  the  weighting  factors 

Yi.  Yj- 

The  fast  subproblem  (k)  is  characterized  by  (10)  and  the 
cost  functional 

J  /  ( z'kfC'kk C** 2k/+  u^Rkulff)<hk.  (37) 


Its  solution  is 


i ikf--Rk~xBikKkfzkf 


where  is  the  positive  semidefinite  stabilizing  solution 
of  the  Riccati  equation 

^kf-Akk  C**Q*  —  KtyB/U'Ri'  'BufKy'-Q,  (39) 
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which,  as  is  well  known,  exists  iff 

the  triples  (Au,  Bu,  CM )  are  stabilizable-detectable.  (40) 

The  specific  form  of  the  control  law  (14)  is  now 


In  this  form  all  the  coefficients  in  (44)  have  well  defined 
limits  as  &  -*0  along  any  trajectory  in  H.  In  particular  let 
Oy-limfSf/S,),  i,/- 1, 2,  then  the  limiting  process  in  (44) 
with  (16)  results  in 


(/—  i 'BuKyAu 1 B ^  )Rla  1 1 +  ^  B^K,  j 


+  &k  ^kk^kf^kk  Ako 


x-Rk~lBUK^k,  *-  1,2.  (41) 


(0M.  +  K>\  (OM 1,  +  (0V<2»  +  (0) 

+  A'MO)+A'MO)+ y.QC., 

+r2c;Jc.2-fA^(0)5.,Aa.(0) 

7] 


When  u,  and  u2  are  applied  to  the  actual  system  (1),  we 
know  from  Theorem  1  that  for  sufficiently  small  S  the 
resulting  response  will  be  close  to  the  predicted  one.  In  an 
optimization  problem  it  is  of  interest  to  check  whether  the 
resulting  values  of  the  cost  functionals  will  be  near  their 
optimal  values.  The  optimal  values  and  J*  are  obtained 
with  the  strategies  uf,  uj  which  optimize  the  costs  for  the 
actual  system  (1). 

Theorem  2:  Under  conditions  (36)  and  (40),  the  ap¬ 
plication  of  u,  and  u2  of  (41)  to  system  (1)  results  in  Jx 
and  J2  satisfying  the  relations 

Hm(/*-/;)-0,  *-1,2  (42) 

where  S  -*0  is  taken  along  any  trajectory  in  H. 

Proof:  The  optimal  strategy  for  the  actual  system  (1) 
and  (31)  is 

(43) 

Y* 


-  f  JU0)s.2JU0)-  f  Kx  (0)i;,^(0) 

72  Yl 

-  ± Ktl(0)SMQ)- f  K„(0)SM0) 

Y:  Yi 

-  ±Kel  (0)suK;tm-~KoomsMQ) 

Yi  Y2 

-±K>iWM0)- 0  (46a) 

Y2 

(0M.,  +  K\  (°M 1 1  +  ^  w>*u  (0) 

+  V^^^;2(0)+y1c;,c11 

"  f  K„(0)StiKu  (0)-±KoX  (0)SuKu  (0) 

Yi  Yi 

+  (46b) 

72 


where  K  is  the  stabilizing  solution  of  the  Riccati  equation  KM  (0)/lo2 +  K.2  (OM22+  2(0) 

KA+A'K+Q-KSK- 0  (44)  +^^22(0)  +  Y2C;2C22 


and 


A  - 


«2I 


A, 

A., 

A»i 

‘  B, 2  ' 

A\o 

^11 

Sj-^12 

TT 

,*2- 

0 

£4i42, 

A22 

A 

*22 

tt 

TZ  j 

U 

. 

Yi 


{K„(0)SalA.Ktl(0)Su)K,3(0) 


Qmf\Q\  +  -iiQi<  S-^-S,  +  J-S2, 

Yi  Y2 


QC., 

^»iQi 

o1 

QQ 

0 

C0’2C22 

- 

c;,c„ 

c;,c„ 

0 

•  02“ 

0 

0 

0 

0 

0 

0. 

.  ^22^,2 

0 

^22^22  . 

-±KM(0)SM0) 

Y2 

-~^(0)SA(0)“0  (46c) 

12 

Ki\  (0M„  +  i4'„X„  (0)  +  Y|C||Cn  —  —  JC,|  (0)S||/r,,  (0) 

Yi 

Oil) 

--£a:12(0)S22*,'2(0)-0  (46d) 

Y2 

!’  KX1 (0)AU+  V^A'UK„ (0) -  *, ,  (0)SnKlz  (0) 

Yi 


S„-BkRk-%,  and  *'-(*'  r',  zi). 

To  avoid  unboundedness  as  S  -*0  the  solution  K  of  (44)  is 
sought  in  the  form 

'  K„  S,*.,  S 2Ko2 

*«!  s,*;,  &xku  Vs^xtJ  |.  (45) 

s2/c;2  VmI  k[2  s2Kj2 


Y2 


*.  2  (0)5^  (0)-0  (46e) 


*22  (0)^22  +  A'nKn  (0)+y2C^Cu  -  ^^(0)5, , AT12  (0) 

Y 1 


-7- *22  mMO) -0  (46f) 
Y2 


where 
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SokmBok&k~  BakmBtkRk  Bikt  SkkmBkkRk  B^. 

The  unique  positive  semidefinite  solution  of  (46d),  (46e), 
(460  is 

Ku(0)-yiKv  *t2(0)-0.  Ku(0)-y2Klf.  (47) 
Then  (46b)  and  (46c)  yield 

K*  (0)  -  (0)£*  ~  Ik  (48) 

where 

Bk  m  (A'ktKkf  +  C'tk  Q*  X^kk  ~  Skt^kf  ) 

and  the  substitution  into  (46a)  results  (after  lengthy 
calculations)  in 

/(„(<)»,+ a;k„(0) 

+  i  \-\koo{0)B„R-'B^Koo(0) 
i-il  r< 

+  yiQ(l-Di,RjiD^)Ci,  -0.  (49) 

This  equation  in  ^(0)  is  identical  to  (35)  in  Ks  for  the 
slow  subproblem.  The  uniqueness  of  the  positive  semidefi¬ 
nite  stabilizing  solution  implies  that 

(50) 

Since  the  above  solution  of  (46)  does  not  depend  on  a,2 
and  a2),  the  limits  Kit( 0)  of  Ktj  are  uniquely  defined  as 
S  -*0  along  any  trajectory  in  H.  We  now  use  this  result  to 
evaluate  the  limit  of  Jf  as  S  -*0  in  H. 


with 


To  evaluate  the  actual  cost  Jk  we  express  u,  and  of  (41) 
as 

K,  0  O' 

ukm — - R^ lBk  S|Y|8T|y  0  i 

[S2* L  0  S2y2*v 
-~±Rk-'BlLx  (56) 

Ik 

where 

Kkm-K,Ek-ykEk-Kka{0). 

When  u,  and  u2  are  applied  to  (1),  they  result  in 

Jk-±x'0N<k%,  *-1,2  (57) 

where  N(k)  satisfies  the  Lyapunov  equation 

N(k\A  -  SL)  +  (A  -  SL)'H(k)+  Q k  +  (58) 

r* 

To  calculate  the  loss  of  performance  (Jk  -  Jk)  we  subtract 
(52)  from  (58)  and  obtain  the  equation  for  N(k)- Mik)~ 

W«\A  -  SL)  +  (A-  SL)’  W™  +  L'SkL 


Jt-jx'0M(k)x0,  *-1.2  (51) 

where  M{k)  satisfies  the  Lyapunov  equation 

M(k)(A  ~  SK)  +  (A  -  SK)'M{k)  +  Qk  +  -L KSkK-0. 

Yfe 

(52) 

Assuming  for  M(l)  and  M(2)  the  form  (45),  we  obtain,  by 
an  analogous  argument,  the  limits 

Aff,"(0 )-*„,  A/fj'(0)-0,  A/£>(0)-0, 

W0)  -  M'"(0)Et  -  E„  A/<i>(0)  -  M£{0)E2  (53) 

Mi?(0)-0,  */#’(<>) -0. 

\ftf(0)-M!?(0)E„  M'a¥(0)-M£(0)i2-E2  (54) 
where  0)  satisfies  the  Lyapunov  equation 

M!?(0)A,  +  A-M'k\Q)  +  Q(/- D^R J 

+  ^k^r^'b^-o  (55) 

r* 


-  -L  KSk  K  +  M[ lk)S  ( K  -  L)  +  ( K  -  L)’SMW  - 0.  (59) 
Y* 

We  again  assume  the  form  (45)  for  This  allows  the 
limit  S  -*0  to  be  taken  in  (59)  along  any  trajectory  in  H. 
Knowing  the  stability  of  A„  (A„-SuKlf)  and  (A^- 
S^Ky)  it  can  be  shown  that 

JimW^-0,  S6W  (60) 

which  proves  Theorem  2. 

An  interpretation  of  the  proposed  design  is  that  a 
Pareto  game  played  on  the  full  system  is  replaced  by  a 
Pareto  game  played  on  the  slow  part  of  the  system  and 
two  regulator  problems  for  the  fast  subsystems.  The  slow 
Pareto  game  has  the  same  weighting  factors  as  the  original 
game.  The  two  regulator  problems  do  not  depend  on  the 
weighting  factors.  This  means  that  each  decision  maker 
optimizes  his  own  fast  dynamics  independently  from  the 
other  decision  maker.  They  need  to  agree  only  on  the 
optimization  of  the  slow  dynamics. 

A  Pareto  game  problem  for  our  power  system  example 
is  solved  in  Appendix  C. 
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VI.  Conclusion 

A  characteristic  of  large  scale  systems  with  multiple 
decision  makers  is  that  the  decision  makers  use  different 
simplified  models  of  the  same  system.  Each  decision 
maker  models  his  own  subsystem  in  detail  and  assumes  a 
certain  “equivalent”  reduced  order  model  of  the  rest  of 
the  system.  In  this  paper  an  attempt  is  made  to  interpret 
this  practical  multimodel  situation  as  a  perturbation  prob¬ 
lem.  In  present  formulation  the  two  basic  assumptions  are 
that  the  fast  subsystems  are  weakly  coupled  and  that  the 
model  of  the  slow  subsystem  is  common  for  all  decision 
makers.  The  latter  assumption  is  less  realistic,  but  has 
greatly  simplified  the  treatment  Our  multiparameter  per¬ 
turbation  analysis  establishes  sufficient  conditions  for  the 
multimodel  response  to  be  close  to  the  actual  system 
response.  This  analysis  serves  as  a  bans  for  a  decomposed 


deviation  from  their  steady  state  values,  the  disturbance 
inputs  can  be  omitted  from  the  equations.  According  to 
(2)  we  choose  S,  -S2 -0.2/20-0.01,  that  is  7^  —  106*, 
Tlk  m  20  Sk .  Then 
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design  approach,  as  illustrated  by  a  power  system  exam¬ 
ple. 

Appendix  A 

We  consider  a  power  system  consisting  of  two  intercon¬ 
nected  identical  areas.  Following  [4],  [5]  the  model  of  each 
area  consists  of  the  governor  equation  (A-l),  the  non-re- 
beat  steam  turbine  equation  (A-2),  and  the  power  balance 
equation  (A-3). 

rcAd--An+AFc-id/  (A-l) 

r(AFc--AFc+An  (A-2) 

TA/-  -A/+  i(APc- AF,- AF„).  (A-3) 


0  0  0 
0  -0.4  0  0 


,JO“[o 


A,' 


B, 


■[ 


-0.05 

0 


0.05] 
-0.1 


y 


Bn k“0,  B, 


kk 


0 

0 

0 

0 

0 


4.5 

0 

-.45 

0 

32.7 


0 

0 

0 

0 

0.1 

0 

0 

0.1 

0 

0 

0  0  0 
0  0  -0.4 


-[!,]■ 


o 

4.5 

0 

-0.45 

-32.7 


1 

-1 

-0.1 

0.1 

0 


Taking  AF,2— AF,^,  the  tie-line  equation  is 

AF  12«7'12  (A/, — A/j).  (A-4) 

To  fulfill  all  design  requirements  [4]  the  integral  of  the 
area  control  error  (ACE)  is  incorporated  into  the  state 
vector 

-  / (ACE)* dr  -  / (AF*.  +  b*Vk  )dt.  (A-5) 


Appendix  B 

In  pole-placement  design  of  the  power  system  defined 
in  Appendix  A,  we  solve  three  subproblems,  one  for  the 
slow  subsystem  and  one  for  each  fast  subsystem.  For  the 
slow  subsystem  the  eigenvalues  are  placed  at 

-0.2  ±/l,  —  0.25±/2.5,  -0.2  (B-l) 

with  the  feedback  gains 


The  system  variables  entering  (A-1HA-5)  are:  An- 
turbine  valve  ;~.«ition  variation;  AFC-  turbine  output 
variation;  A/- frequency  variation;  AFr -speed  changer 
variation;  AF12- tie-line  power  flow  variation.  Typical 
numerical  values  of  the  system  parameters  are  r— speed 
regulation -0.25;  T0  -  governor  time  constant-0.1;  7*,— 
turbine  time  constant-0.2;  7*—  system  inertia  time  con¬ 
stant-20;  Ti2- synchronizing  power  flow  coefficient  - 
32.7;  D-0.5,  6, -4.5.  All  quantities  are  in  per  unit  and 
time  is  in  seconds.  Assuming  a  constant  load  disturbance 
AFrf  and  redefining  the  state  and  control  variables  to  be 


G„-[ -0.2486  0.1375  -  2.5  3.0  -  0.9268]  (B-2) 
Gj,— [ -0.0556  -  0.0556  0  0.5  -  0.9924].  (B-3) 


For  convenience  we  assume  that  the  desired  eigenvalues 
of  the  two  fast  subproblems  are  the  same.  The  £th  fast 
subsystem  eigenvalues  are  placed  at 


-8,  -12 

(B-4) 

with  the  feedback  gain 

Gifm  [  -0.42  -0.5]. 

(B-5) 

1 

I 

I 

I 

r 


KHALIL  AND  KOKOTOVIC:  CONTROL  STtATKHlS  KM  OK3SON  MAORI 


Therefore,  from  (14),  the  feedback  control  is 

tr,-[ -0.4773  0.264  -  8.48  5.76  -1.78]* 

4-  [  —0.42  -0.5]z,  (B>6) 

[  -0.1067  -0.1067  0  -  2.72  -1.91]* 

+  [-0.42  -0.5]z2.  (B-7) 

When  u,  and  u2  are  applied  to  actual  system  (1)  the 
resulting  eigenvalues  are 

-12.964,  -11577,  -7.05,  -6.37, 

-  0.252  ± >1634,  -0.21  ± y.099,  -  0.2095,  (B-8) 

which  are  close  to  their  desired  locations, 

(-11-11  -8,  -8,  -0-25±y2.5,  -0-2±y.l,  -0.2). 


Appendix  C 

Let  the  cost  functionals  J„  J2  of  the  area  decision 
makers  in  the  power  system  of  Appendix  A  be  defined  by 

G,-diag(l,  1,1, 1,1,1, 1,0,0)  (C-l) 

.G2-diag(l,  1,1,1, 1,0,0, 1,1)  (C-2) 

/f,-/t2-20.  (C-3) 

Suppose  that  they  agree  on  a  Pareto  game  with  weight¬ 
ing  factors 

Ti  — Y2— 0.5.  (C-4) 

The  solution  of  the  slow  subsystem  Pareto  problem  is 
«„-[ -0.3015  0  -  4.079  1.8219  -  0.0478]*,  (C-5) 
«j,-[0  -0.3015  1.8219  -4.079  -0.0478]*,.  (C-6) 
The  fcth  fast  subsystem  is  optimized  by 

uv-[  -0.0162  - 0.0326 (C-7) 
Then,  according  to  (41),  the  control  law  is 

«,■[— 0J162  0  -4.473  1.911  -0.05]* 

+  [  -  0.0162  -  0.0326  ]  z ,  (C-8) 

i<2-[0  -  0.3162  1.911  -4.473  0.05]* 

+  [-0.0162  -  0.0326 ]z2.  (C-9) 

To  evaluate  the  cost  functionals  using  (57),  we  assume 
that  the  initial  conditions  are  zero  mean  independent 
random  vector  with  covariance  matrix 

£{*,*;}  -  J0-4diag(l,  1..01..01, 1. 1, 1, 1, 1).  (C-10) 

This  choice  is  typical  given  the  physical  meaning  of  the 
state  variables  [4].  Then  the  average  value  of  the  cost 
functionals  are 

£(/,  }-£{72} - 12.75 xlO’4.  (C-ll) 


If  this  Pareto  problem  had  been  solved  for  the  actual 
system  (1),  the  optimal  solution  would  have  been 

«,•-[ -0.3162  0  -  4.5806  1.8694  0.053]* 

+  [-0.1079  -  0.0759]z,  +  [0.0378  0.0176]z2  (C-12) 

Uj*-[0  -  0.3162  1.8694  -  4.5806  -  0.053]* 

+  [0.0378  0.0176]z,  +  [ -0.1079  -  0.0759  ]z2  (C-13) 

resulting  in  the  average  values 


£{yr}-£{y2*}-11.7xl0-4.  (C-14) 

Thus,  from  (C-ll)  and  (C-14),  we  find  that  each  cost 
functional  has  a  loss  of  nine  percent,  that  is 


E  {>,)-£{>?} 

E{'?) 


E{J2  )-£{/?} 

£{/?} 


-0.09.  (C-15) 


In  a  more  general  case,  when  the  two  control  areas  are 
different,  the  application  of  the  control  law  (41)  may 
result  in  one  of  the  decision  makers  benefiting  instead  of 
having  a  loss. 
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i>-ST ABILITY  AND  MULTI- PARAMETER  SINGULAR  PERTURBATION 

HASSAN  K.  KHALILt  and  PETaR  V.  KOKOTOVtC* 

Ahearact.  A  new  multi-parameter  singular  perturbation  problem  is  formulated.  Sufficient  conditions 
for  uniform  asymptotic  stability  are  derived,  and  asymptotic  behavior  of  solution  is  investigated. 

1.  Introduction.  Single  parameter  singular  perturbations  have  been  extensively 
used  in  analysis  and  control  of  dynamic  systems  [1].  Even  if  they  possess  several  small 
parameters,  electrical  networks  with  parasitics  and  control  systems  with  small  time 
constants,  masses,  etc.,  are  modeled  as  single  parameter  problems.  This  is  done  by 
expressing  small  parameters  as  known  multiples  of  a  particular  parameter  n,  such  as 
m  ■«!>*.  T  *  where  m  is  a  small  mass  and  T  is  a  small  time  constant.  A 
characteristic  of  this  approach  is  that  its  results  depend  on  the  scaling  coefficients  at, 
which  are  assumed  to  be  known.  In  many  cases  of  practical  interest  such  an  assump¬ 
tion  cannot  be  justified.  In  multi-controller  problems  and  differential  game  problems 
small  parameters  may  represent  different  independent  ways  in  which  individual 
control  agents  simplify  the  model  of  the  overall  system,  and  therefore  the  relation 
between  the  small  parameters  must  remain  arbitrary  [2].  It  may  be  argued  that  a  more 
realistic  study  of  parasitics  should  also  allow  for  the  ignorance  of  the  ratios  of  small 
parameters. 

The  purpose  of  this  paper  is  to  examine  the  vector  singular  perturbation  problem 
when  all  the  small  parameters  are  of  the  same  order  of  magnitude,  but  can  have 
arbitrary  bounded  ratios.  This  problem  is  different  from  the  multiple  time  scale 
problem  [3],  [4]  when  the  parameters  are  of  different  orders  of  magnitude.  We  treat 
the  uniform  asymptotic  stability  and  initial  value  problems  for  multi-parameter 
singular  perturbations.  In  contrast  to  the  boundary  layer  system  stability  requirement 
of  the  single  parameter  case  [1],  we  employ  a  generalization  of  D-stability.  Several 
tests  are  given  delineating  important  classes  of  systems  satisfying  this  condition. 

2.  Multiparameter  perturbations.  Linear  systems  with  N  singular  perturbation 


*(ro)*  *0. 

r,(r0)*r,o, 

where  that  is  the  system  dimension  is  n  *  n0  +  The  small 

positive  scaiars  t !,•••.»*  represent  time  constants,  inertias,  masses  and  similar 
physical  parameters  (Ij.  They  are  ordered  as  components  of  a  vector  t  sRs.  System 
(1)  satisfies 

Assumption  1.  For  all  t3tt0,  all  the  matrices  on  the  right  hand  side  of  (1)  are 
continuous,  bounded  and  have  bounded  first  derivatives. 

A  characteristic  of  singularly  perturbed  systems  is  that  the  variables  are  fast 
since  their  derivatives  are  1/s,  large.  Under  the  additional  assumption  that  e.-i/t,  —  0 


parameters  s  i ,  •  •  •  ,  s,v  have  the  general  form 

M 

x  -  A0(t)x  +  I  A0f(f)*„ 

i-i 

.V 

e,i,  -  A,0(f)x  i-  I  Aa(t)z„ 

/-i 


(la) 

(lb) 
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as  e, - 0 ,  the  system  (1)  exhibits  N  time  scales,  that  is  is  fast  relative  to  z,.  In  [3j, 

[4]  such  multi-time  scale  systems  are  treated  by  nested  single  parameter  pertur¬ 
bations.  However,  in  many  real  systems  the  parameters  are  of  the  same  order  and  do 
not  allow  the  multi-time  scale  assumption.  We  therefore  assume  that  the  ratios  of 
ci,  ■  •  ■ .  ts  we  bounded  by  some  positive  constants  m  and  M 

(2)  i, / -  1,  •  •  • ,  N, 

«< 

that  is  the  possible  values  of  t  are  restricted  to  a  cone  H<zRN.  In  contrast  to  the 
multi-time  scale  systems,  in  our  case  all  r,'s  are  in  the  same  time  scale.  We  call  this 
case  the  multi-parameter  problem.  A  fundamental  requirement  for  every  multi- 
parameter  perturbation  result  is  to  hold  for  ail  sufficiently  small  1 6  H,  that  is  as  t  -»0 
along  any  arbitrary  path  in  H. 

System  (1)  is  rewritten  in  a  form  resembling  a  single  parameter  penurbation 
problem 

(3a)  x » A0(t)x  +Aq/0)z.  x(r0)»  x0. 

(3b)  fiz  »DAfo(t)x+DAr(t)z,  z0o)mzo- 

However,  it  is  not  a  single  parameter  problem  because  both 

(4)  n  ■  •  •  Ss)l,N 

and 

(5)  D  -  Block  diag  [—/„•••  /vl 

U,  c/v  J 

depend  on  all  ’ s.  The  above  form  is  convenient  since,  in  view  of  (2),  the  matrix  D  is 
bounded  for  all  e  €  H, 

(6)  mS-SAf 

t, 

where  m,  M  depend  on  m,  M.  The  matrices  A0/,  Af0  and  Af  are  formed  of  the 
submatrices  A0l,  A,0  and  Aih  i,j  »  1.  •  •  •  ,S,  respectively,  and  **  [r'L,  •  •  • ,  z's}-  A 
reduced  system  is  now  formally  obtained  by  setting  t  *  0  in  (3), 

(7a)  i  »  A0(f)i  +  Ao/(t)f.  2  x(r0)»  x0. 

(7b)  0-A,o(t)i  +  A,(t)i. 

Assuming  that  det  A,(t )  2  k  >  0  for  all  f  2  to.  (7)  can  be  rewritten  as 

(8)  i-[A0(r)-AoKr>A7l(OAro(f))iAA,(r)i.  f(t0)-*o. 

We  also  define  a  boundary  layer  system 

(9)  DAf(t0)z(r),  z(0)~z„-2(t 0), 

dr 

where  r  *  (r  -  r0)/M  is  the  "stretched”  time  scale. 

We  are  concerned  with  two  problems.  First,  we  seek  conditions  for  the  uniform 
asymptotic  stability  of  (1)  for  ail  sufficiently  small  t  s  H.  Second,  we  want  to  approx¬ 
imate  the  solutionof  the  initial  value  problem  (1)  in  terms  of  the  solution  of  the 
reduced  problem  (8)  and  the  boundary  layer  problem  (9). 
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For  the  first  problem  we  make  the  following 

Assumption  II.  The  reduced  system  (8)  is  uniformly  asymptotically  stable. 

3.  Main  results.  Our  crucial  assumption  is  a  generalization  of  the  so  called 
D-stability  property  of  the  boundary  layer  system. 

Assumption  III.  For  all  1 2 10,  the  matrix  Af(t)  has  the  property  that 

(10)  Re  A  {DAf(t))  2  -2<r  <  0 

where  <r  is  a  fixed  scalar  independent  of  *,  possibly  depending  on  the  bounds  m  and 

M. 

The  main  results  of  this  paper  are  summarized  in  the  following 
Theorem  1.  Under  Assumptions  I,  II  and  III  there  exists  a  positive  scalar  v  such 
that  for  all  e  6  H,Q<  ||*||  A  v,  system  (1)  is  uniformly  asymptotically  stable. 

Theorem  2.  If  Assumptions  I  and  III  are  satisfied  then  for  every  finite  T>  t0  there 
exists  a  positive  scalar  v  such  that  for  all  t  E  [f0,  T]  and  all  e  eH,0<  ||»  ||  A  v,  the  solution 
of  the  initial  value  problem  (1)  is  approximated  by  the  solution  of  the  reduced  problem 
(8)  and  the  boundary  layer  problem  (9).  that  is, 

(1U)  x(r)-i(r)+ 0(11*11) 

(lib)  z(t)*-A;\DAro{t)*(t)+£(T)+  0(||«||). 

Moreover,  for  all  t  e  [fi,  7],  f0  <  ft  <  7 

(12a)  x(r)-x(r)-t- 0(11*11) 

(12b)  z(r)-  -V(f)>W/)x(r)+0(||«i|). 

If  in  addition  Assumption  II  is  satisfied  then  (11)  and  (12)  hold  for  all  7  s  (r0.  x). 

Our  Assumption  III  has  a  general  form,  but  it  is  not  verifiable  by  an  algorithm 
with  a  finite  number  of  steps.  It  is  satisfied  in  special  cases  such  as  when  Af(t)  is  block 
diagonal  or  block  triangular  with  the  on-diagonal  matrices  satisfying  the  condition 

(13) 1  Re  A{A„(f)}  A  -c„  for  ail  1 2  r0,  i  *  1,  •  ■  •  ,  .V. 

Another  special  case  is  when  Af  is  constant  and  the  Zj’s  are  scalars.  Then  Assumption 
III  means  that  Af  is  O-stable,  that  is  DAr  is  a  stable  matrix  for  all  diagonal  matrices  D 
with  positive  elements.  Several  D -stability  conditions  have  been  investigated  in  the 
economic  literature  [5].  Recently  this  concept  has  been  used  in  large  scale  system 
analysis  [6],  [71. 

Our  Assumption  III  can  be  considered  as  an  extension  of  the  notion  of  In¬ 
stability  to  matrices  depending  on  t  and  to  vector  rather  than  scalar  subsystems,  that  is 
when  /i(>l.  In  this  more  general  framework  we  now  examine  several  conditions 
allowing  us  to  test  Assumption  III.  The  first  condition  is  the  following: 

(i)  There  exists  a  block  diagonal  positive  definite  matrix  P(r), 

(14)  P{t)  ■  Block  diag  (Pt(f),  ■  •  • .  Ps(t)  1 
satisfying 

(15)  C:l|xl|2Sx'P(0x  Sc3||xii2  for  all  x  s  R5’"1.  f2f0, 
such  that  0(f)  given  by 

(16)  P{t)A,(t)  +  A',(t)PU)--Q(t) 


1  !n  this  section  c,.  c:.  ire  used  to  denote  various  need  positive  constant  scalars. 
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is  bounded  from  below  by 

(17)  x'Q(t)x  Scjjxll2,  forallxetf1'"',  /s/0. 

This  condition  implies  (10) since  the  Lyapunov  function  v(x)»x'P(t)D~'x  for  the 
system  dx/ds  ■  DAf(i)x  has  the  negative  definite  derivative  dv/ds  *  -x’Q(t)x. 
Although  this  condition  does  not  require  the  knowledge  of  D,  it  is  still  not  finitely 
verifiable.  However,  it  can  be  used  to  generate  classes  of  matrices  satisfying  (10).  An 
example  is  the  case  when  Af(t)  is  symmetric  with  A{A^(r))S-c}  for  all  /2/o-  Then 
condition  (i)  is  satisfied  by  P-f,  while  c2  ■  c3  -  1,  c*  ■  2c $  satisfy  (15),  (17). 

The  next  condition  involves  two  different  conditions  introduced  in  [8],  [9]  as 
sufficient  conditions  for  stability  of  matrices  with  dominating  diagonal  blocks. 

(ii)  The  matrices  A„(t)  are  symmetric  with 


(18) 

A  {A«(/)j  £  -  c6  for  all  / 2  /0, 

/  »  1.  •  •  •  .  Af, 

and  either 

(19) 

I  !lA,*(r)||<c«  for  all/ 2  f0. 

/  -  1,  •  •  • .  N. 

or 

(20)* 

I  ||Aj‘(/)Ai*(/)(|<l  for  all/ 2/o, 

«  -  !.•••. 

k»i 


If  Af(t)  satisfies  (18)  with  (19)  or  (20)  then  DAf(t)  satisfies  the  same  condition  with  c6 
replaced  by  mc«  where  m  is  the  lower  bound  in  (6). 

The  last  two  conditions  are  due  to  Siljak  [6]  and  Michel  [7J  who  derived  them 
using  the  decomposition  aggregation  method  to  test  the  stability  of  interconnected 
systems  when  the  isolated  subsystems  are  stable.  In  these  conditions  the  matrices 
A„(t)  satisfy  (13)  and  symmetric  positive  definite  P,(t),  Qt(t)  are  such  that 

(21)  P,(t)Aa(t)+A'u(t)P,(t)-  i  -  1.  •  •  • .  N. 

Then  there  exist  positive  constants  ir,u  irj2>  irl3  and  ir,»  satisfying 

(22)  l|A„(f)#  S for  ail  t  2 / 0, 

(23)  fl\il|xtj2Sx7»(;)x  Sir,2jjxi|2.  for  ail  x  s  R*',  /  2/0, 

(24)  itvjM2  £  x'0,(t)x  £  ir,4x||\  for  all  x  €  R*\  /  2/0. 

In  both  Siljak's  and  Michel's  condition  an  ;V  x  /V  aggregation  is  formed  and  tested  for 
the  stability  of  Af(t).  The  elements  of  Siljak’s  aggregation  matrix  5  are 

(25)  nr-.  imj; 

I&ViiVi*.  1*J 

where 


Vn 


and  those  of  Michel’s  matrix  T  are 


(26) 


d,ir,2  in  — 


i  *  A 
i  *i> 


1  The  matrix  norm  in  (10)  i*  defined  u  i|AI|  ■ 
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for  some  positive  numbers  du  -  ■  ■ ,  d*. 

The  Siljak  condition  ts  the  following: 

(iii)  The  matrices  Ajt(f)  satisfy  (13)  and  the  principal  minors  \fk  of  S  have 
alternating  signs,  that  ts 


(27) 


Mk  »(—!)*  det 


'Ju  •  '  '  fu' 


>0.  Ic  ■  1,  •  •  •  ,  N. 


LSk\  •  Sk*. 

To  show  that  his  condition  implies  Assumption  III  we  consider  the  Lyapunov 


function 

(28) 

with 


u(x)»  i  —  v,(Xi),  x'*(r  ,x'n\  x,s  R“ 

,-l  ft 


[ 29 )  ».(*.)- (*Ii»i(i)*i),/ 

where  5,  >0.  i  »  l.  ■  ,  .V.  are  yet  unspecified  numbers.  By  derivation  similar  to  that 
in  [6]  it  can  be  shown  that  the  derivative  of  u  with  respect  to  the  system 


(30) 

satisfies  the  inequality 

(31) 


£-04,(0* 


dt>  *  ,  " 

T*  I  S  siM- 

as  i-i  ,-i 


Tt  is  shown  in  [6]  that  when  inequalities  (27)  are  satisfied  there  .ist  numbers  6,  >0 
(i  »  I,  •  •  • ,  jV)  and  ir  >  0  such  that 


(32) 


dv  £ 

—  S-ir  £ 
ds  ,.i 


5iOj. 


Hence 

(33) 


■ r-S-irmv  +-ciu. 
ds 


The  iast  condition  is  that  of  Michel: 

(iv)  The  matrices  A„(f)  satisfy  (13)  and  there  exist  numbers  d(,  i »  1.  •  •  ■ ,  M  such 
that  the  matrix  T  is  negative  definite. 

To  show  that  this  condition  implies  Assumption  HI  we  consider  the  Lyapunov 
function  (28)  with  5,  replaced  by  d<  and  Ui(*,)  given  by 

(34)  v,(x,)~x:PXt)Xi. 

In  a  way  similar  to  [7]  it  can  be  shown  that  its  derivative  with  respect  to  (30)  satisfies  the 
inequality 

(35)  I  Uriiilix.il. 

Since  T  is  negative  definite,  let  A  *  Am„(7)<0;  thus 


(36) 


dv 

— a-A 

ds 


I  kil- 


■-a:!*i! 
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Using  (22)  and  (36)  we  obtain 


(37) 


dv  -Am 

ds  max,  d,  max,  iri2 


V  ±  -c%v. 


Michel’s  condition  is  not  finitely  verifiable  since  it  requires  the  existence  of  positive 
numbers  d i,  •  •  • ,  dN.  However,  a  more .  conservative,  finitely  verifiable,  condition 
implying  Micnel’s  condition  can  be  obtained  [7]  by  writing  the  matrix  T  as 


(38)  r-z5w+ wz5 
where 

(39)  0  -diagfdu  •  •  • ,  dN\,  d(>0, 
and  W  is  given  by 

(40) 


1  i/.  i  *  /• 


Then,  if  the  principal  minors  of  W  have  alternating  signs,  that  is,  satisfy  (27),  there 
exists  matrix  S  such  that  T  is  negative  definite. 

It  is  important  to  notice  that  Siljak’s  and  Michel’s  conditions  are  not  equivalent. 
In  fact  examples  can  be  constructed  for  matrices  which  satisfy  one  of  them  and  do  not 
satisfy  the  other,  and  vice  versa  [9].  These  two  conditions  are  particularly  important 
since  they  are  applicable  to  large  scale  systems.  They  are  also  applicable  to  nonlinear 
systems.  Grujic  [11]  has  used  the  decomposition-aggregation  method  to  test  the 
stability  of  a  class  of  nonlinear  singularity  perturbed  systems.  The  motive  to  look  at 
these  two  conditions  and  study  their  implication  to  our  Assumption  III  was  that  the 
aggregation  matrices  S  and  T  which  satisfy  the  respective  condition  are  D -stable. 
However,  as  we  have  shown,  the  proof  that  Siljak’s  or  Michel’s  condition  implies 
Assumption  III  does  not  rely  upon  the  D-stability  of  S  or  T,  because  we  have  chosen  the 
Lyapunov  function  in  either  case  in  such  a  way  that  we  obtain  the  aggregation  matrix 
independent  of  D. 

The  above  discussion  of  Assumption  III  shows  that  the  class  of  matrices  A,(t) 
satisfying  Assumption  III  contains  important  subclasses.  However  a  complete  charac¬ 
terization  of  that  class  is  yet  to  be  made  by  further  studies. 


4.  Proof.  We  follow  [12]  to  separate  the  fast  and  siow  modes  of  (3).  Using 
ry],[/-MA#D-,£.  -  ^VfZT1  Jj\rJ 


the  system  (3)  is  transformed  into 

(42a)  y  ~  (A0(t)~  Aof(t)L(t))y. 

(42b)  txu  =  (DAf(t)  + nL(t)Aof(‘))v. 

where  u(r)  and  ,Vf(r)  satisfy 

(43)  iaL  *  DAfL  —  DAf<j  — pLAt)-1- uLAofL, 

(44 )  nMD  »  -MAf~A„f  -  nMD  ' '  L A 0,  +  u-A UMD  “ ' 1  -  M A „,L\tD  ~ ' . 
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with  the  initial  conditions 

(45)  Uto)-AJl(t0)Am(to), 

(46)  mo)'*A0,(t0)A7[(to). 

We  lint  observe  that  the  fast  subsystem  (42b)  is  of  the  form 

(47)  ixi  •  (DAf(t)  *  m  Hr,  t  ))r 

whose  properties  we  examine  in  Lemmas  1  and  2.  Then  in  Lemmas  3  and  4  we 
establish  the  existence  and  convergence  of  solutions  L(t)  and  M(t)  of  (43)  and  (44). 
Lemmas  1,  2.  3  and  4  are  stated  under  the  Assumptions  I  and  Ill. 

Lemma  1.  There  exist  positive  scalars  v,  Kt  and  y,  such  that  for  all  es  H, 
0  <  )|e  ||  2  v  and  ds,  the  state  transition  matrix  <p{(t,  s)  of  the  system  (47 )  with  F  *  0  has 
the  property  that 

(48)  !!*,(/.  i)|| S  exp  [-£(f-s)]. 

Proof.  By  Assumption  I  and  (6)  we  have  |DA,(/)||S  K2,  for  all  1 2  r0  and  e  sH. 
Using  (10)  and  Lemma  4  of  [13,  p.  116}  we  get  for  all  9  SO,  e  eH 

(49)  jjexp  £~DA,(/)j|  iKj  exp  ("*)> 

where  Kj  depends  only  on  it  and  Kl.  Also  there  exists  0  >0  such  that  $DA,(t2)- 
l?'‘Mf1)IIS0|r2-r1|,  ft,  t2 S  fa.  Then  by  Theorem  12  of  [13,  p.  117)  there  exists  >x*>0 
such  that  for  all  n  <m*.  ?»(/,  s)  satisfies  (48)  with  Kx  *  K\  and  yi  <<r\  and  v  can  be 
chosen  to  be  the  radius  of  the  largest  ball  centered  at  the  origin  with  n<t u*. 

Lemma  2.  If  ||r(r,  «)j|S  K*,  for  all  r  St  to,  *  S  H,  then  there  exist  positive  scalars  v, 
72  <  y  i,  such  that  for  all  s  e  H,  0  <  ||s  ||  S  v  and  /  Si,  the  state  transition  matrix  ip2(t,  s )  of 
(47)  satisfies 

(50)  ||Vl«.i)l|Slf.eJtp[-J(f-i)]. 

Moreover,  there  exists  v>0,  Ks>Q  such  that  for  all  e  s  H.  0  <  |j<  i|  S  v,  t  S  t0,  the  matrix 
<l>s(t,  to)  -  <<n(‘,  to)  -  e*P  [£>Af(toX(t  -  to)/  fM  )J  satisfies 

(51)  ll<pj(t,  fo)(l  3i  X’sikll- 

Proof.  Inequality  (50)  follows  from  Lemma  l  and  Theorem  9  of  [13,  p.  70J.  To 
prove  (51)  we  notice  that  <pj(t,  t0)  satisfies  the  equation 

<pj(t,  t0)~~(DAf(t)  +  ur(t,  e)l<pj (/,  to) 

M 

+  ^[DA,(t)~  DA, (to)  +  m  Hz,  e ))  exp  ^ DA, ('o)(~”)  ] ■ 

Noting  that  <p](t0,  to)  *  0,  we  obtain 

I  <PiU,  r)  —  [DA,(T)-DA,(to)  +  v.r(T,  e))  exp  \  DA,(t0)~ — — |  dr. 

\  u  t  u  ■> 
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Using  Lemma  1.  (50),  and  the  fact  that  \DAf(t)- DAAt0^\HHt  -  !0),  we  obtain 
folk*.***?  0)  +  nK*)e-("'“*r"°>dT 

1,..  M 


i~  ,-CV»*-V  f  [fi{T-t0)  +  nK*]dT 
M  Jro 


* 


S(JC2 


r  40 . 

Uie2 

y2eJ 

20 

yU‘ 

Yi*  J 

Next  we  establish  the  existence  of  solutions  of  (43)  and  (44).  Let  us  rirst  remark 
that  the  state  transition  matrix  of  the  system  ?j  mAu(t)v  satisfies 


(52) 


!|vo(f.  s)l|S  K6  exp  [yjif-rl],  for  all  r.  s  S  r0, 


for  some  positive  constants.  Kt,  y3,  (see  [14,  p.  287]). 

Lemma  3 .  There  exists  a  positive  scalar  v  such  that  for  all  e  £  H,  0  <  ;|e  ||  S  v,  t  S  r0, 
there  exists  a  continuously  differentiable  bounded  solution  L(t)  of  (43)  and  (45), 
satisfying 

(53)  L(r)-A7l(0>W')+O(M). 

Proof 3  Every  solution  of  the  integral  equation  L(r)»  SL(r),  where 
SL(t)»  <pi(t,  t0)Af '  (t0)Afo(to)<po(to,  t) 

+ 1  <Pi(r,  r)^DA/0(4)^L(s)Aor(j)L(j)j«Po(j,  0  ds 


(54) 


is  a  solution  of  (43)  with  initial  condition  (45).  Hence  it  is  sufficient  to  prove  the 
existence  of  a  solution  of  this  integral  equation.  Using  the  identity 

(55)  LAorL  —  LA0fL  =*  [L  —  L)AofL  +  LA0f(L  —  L) 
and  expressions  (48)  and  (52)  we  obtain 

(56) 


1151(f)  -  S£(t  DU  S  — ^~i|L  -  L'||  ||Aoril(l|L||  *  i|L||), 
ri  -  My: 


and 


(57) 


;|5L(f))|S 


KxK* 

Y\-UTi 

+■ 


■(!|i3A/oil  +m\A0f)\  IlLi!2) 


K{K*\\Af '  (f0)(|  ]|A^oi|  exp  j^-^— —  yj^(f  -  fo)J  ■ 


'  In  this  proof  L  belongs  to  the  space  of  bounded  continuous  Z, «.  x  no  matrix  functions  on  the  interval 
(t0,  *)with  the  norm  l£.i»sup,„,,|£.(r)||  where  the  matrix  norm  can  be  any  norm.  This  space  is  a  Banach 

space. 
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Letting 

(58)  p  «  2ifl/C4(^||Z?Awl|+M7l(to)l|  l|A,ol|) 

we  choose  m  *  >  0  so  small  that 

(59)  and  —'**** \\A0,b  ■ 

2  ?i 

If  1|L|i  2  p,  i|Li|  S  p.  then  for  0  <  m  S  m  *  we  get 

(60)  ||SL-S£||Sil|L-£!l 
and 

(61)  l!SL(t)(|SJp. 

By  the  contraction  principle  the  solution  L(t)  exists  and  is  unique  >n  ||£!|Sp.  To  prove 
(53)  we  let 

(62)  L(f )  “  A;1  (r)A,o(t)  +  Cd.U)  ±  Lo(t)-*-  AL(f ). 

We  note  that  4L(r0)  m0  and  that  \L(t)  satisfies 


(63)  £L  *—(DAf  + tiLoAo)&I.  —  \LA,  +  &LAof&L  + R\, 

where  -  LoA0fL0- LoA0- L0.  Let  <pr(t,s)  and  <p*(t,s)  be  the  state  transition 
matrices  of  equation  (8)  and  m  (DA/(t)+ ixAj1  (t)Afo(.t)Aof{.t))£.  respectively.  The 
norm  of  <p,(f,  s)  satisfies  an  inequality  similar  to  (52)  with  constants  Kr  and  y*.  By 
Lemma  2,  the  norm  of  s)  satisfies  an  inequality  similar  to  (50)  with  constants  K\ 
and  y,  <  y(.  Then  from  the  form  of  the  solution  of  (63) 

(64)  AL(/)*  [  <p*(t,s )( <11 {s)Aof(s )AL(s)+Ri(s )]<p,(s.  f )  ds, 
it  follows  that 


(65) 


||AZ.(r)(|  2  -^^-dlAoril  ULf + m  .11) 

2  p^(l|Aorj|0Loi|  +  !!L!|)2  +  11*  ill)* 
ys 


mViV 


for  some  positive  constant  Kt,  which  proves  (53),  and  v  can  be  chosen  in  a  way  similar 
to  that  in  Lemma  1. 

Lemma  4.  There  exists  a  positive  scalar  v  such  that  for  all  e  €  H.  0  <  :\e  II  S^i.  to; 
there  exists  a  continuously  differentiable  bounded  solution  M{t)  of  (44)  and  (46), 
satisfying 

(66)  M(t )  -  A0f(t )A  7 ' (t )  +  0(11* !|). 


The  proof  of  this  lemma  is  similar  to  that  of  Lemma  3.  Based  on  Lemmas  3  and  4 
the  matrices  of  the  transformed  system  (42)  can  be  written  as  0(!|a;j)  perturbations  of 


D-STABILITY  and  perturbation 

A,(r).  DA,(t).  that  is  (42)  becomes 

(67a)  y -(*,(/) +  0(lM))y.  y(fo)-Jco  +  0(i|ei|) 

(67b)  u.c -(ZM,(f)+Ofl|ti|))»,  u(t0)*io  +  U(to^o  +  0(!i«||). 

Proof  of  Theorem  1.  Since  the  transformation  (41)  is  nonsingular  for  all 
sufficiently  small  is  H  and  L(t),  M  (r)  are  bounded  for  ail  t  S  t0,  it  is  sufficient  to  show 
that  each  subsystem  (67a)  and  (67b)  is  uniformly  asymptotically  stable.  This  immedi¬ 
ately  follows  from  Lemma  2  and  Theorem  9  of  [13.  p.  70], 

Proof  of  Theorem  2.  The  uniform  convergence  y(r)-»i(f)  as  lki|-*0  follows  from 
the  continuous  dependence  of  the  solution  of  (67a)  on  the  right-hand  side  and  the 
initial  conditions.  Lemma  2  guarantees  the  uniform  convergence  u(r)-»  r((f- t0)//s)* 
f(r).  Using  the  inverse  transformation  of  (41),  we  obtain 

(68a)  x(t)*  y(t)+nM(t)D~lv(t)m  x(t)+OQ\e\\), 

(68b)  :(')*  -nL(t)M(')D “></)- -M;V)A,o(r)j?(0+^)+O(IM) 

which  proves  (11). 
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Control  of  Linear  Systems  with  Multiparameter 

Singular  Perturbations* 

HASSAN  K.  KHALILt  and  PEI  AR  V.  KOKOTOVICJ 

The  boundary  layer  stability  of  multiparameter  singularly  perturbed  systems  is  the 
major  problem  in  the  design  of  a  near  optimal  control  which  disregards  the 
perturbation  parameters. 

Key  Word  lades — Perturbation  techniques;  approximation  theory;  system  order  reduction;  stability; 
optimal  control;  differential  games. 


Abstract — The  singular  perturbation  theory  is  extended  to 
systems  with  several  small  parameters  which  can  change  the 
system  order.  Difficulties  arising  in  testing  the  boundary  layer 
stability  in  multiparameter  linear  problems  are  discussed.  The 
theory  is  applied  to  linear  quadratic  optimal  control  and 
Nash  game  problems. 


1.  INTRODUCTION 

When  several  small  singular  perturbation  para¬ 
meters  of  the  same  order  of  magnitude  are  pre¬ 
sent  in  the  dynamic  model  of  a  physical  system, 
the  analysis  and  control  problems  surveyed  in 
Kokotovic,  O’Malley  and  Sannuti  (1976)  are 
usually  approached  as  single  parameter  pertur¬ 
bation  problems.  This  is  done  by  expressing 
small  parameters  as  known  multiples  of  a  parti¬ 
cular  parameter  n,  such  as 
where  m  is  a  small  mass  and  T  is  a  small  time 
constant.  A  limitation  of  that  approach  is  that 
the  scaling  coefficients  /?,  are  assumed  to  be 
known.  Thus,  it  is  not  applicable  to  a  large  class 
of  problems  where  the  parameters  represent  small 
unknown  parasitics  whose  values  are  not  known 
exactly,  although  they  are  limited  to  lie  within  a 
certain  set.  Such  a  situation  arises  also  in  multi- 
controller  design  problems  when  small  para¬ 
meters  represent  different  independent  ways  to 
simplify  the  model  of  the  overall  system  by 
individual  control  agents  (Khalil  and  Kokotovic, 
1978). 
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In  Khalil  and  Kokotovic  (1979)  we  have  for¬ 
mulated  the  multiparameter  singular  perturbation 
problem  and  stressed  its  difference  from  the  mul¬ 
titime  scale  problem  (Hoppensteadt,  1969).  We 
have  shown  that  the  block  ©-stability  property  of 
matrices  is  a  sufficient  condition  for  the  asymp¬ 
totic  stability  of  the  boundary  layer  system. 
Several  block  ©-stability  conditions  have  been 
derived.  ■ 

In  this  paper  we  discuss  the  difficulties  in¬ 
volved  in  testing  the  stability  of  the  boundary 
layer  system  in  the  multiparamcter  linear  prob¬ 
lem.  We  investigate  the  block  ©-stability  pro¬ 
perty  of  matrices  and  establish  its  relationship 
with  the  stability  criteria  for  the  multitime  scale 
problem.  We  also  show  how  the  decomposition- 
aggregation  stability  tests  can  be  used  as  block 
©-stability  tests.  Electrical  networks  are  given  as 
examples  of  physical  systems  having  the  block  ©- 
stability  property.  Since  for  many  problems  of 
interest  the  block  ©-stability  is  restrictive,  an 
alternative  way  to  verify  the  boundary  layer 
stability  is  proposed.  We  then  proceed  to  the 
multiparameter  singularly  perturbed  linear  op¬ 
timal  control  problem,  discuss  its  well-posedness 
and  design  a  near  optimal  control  which  does 
not  depend  on  the  values  of  the  small  para¬ 
meters.  Hence  this  control  is  applicable  to  sys¬ 
tems  where  the  parameters  are  unknown.  Finally, 
we  discuss  the  asymptotic  behavior  of  a  closed- 
loop  Nash  solution  of  infinite-time  linear- 
quadratic  differential  games  for  multiparameter 
singularly  perturbed  systems. 

2.  MULTIPARAMETER  SINGULAR  PERTURBATIONS 

We  consider  the  linear  time-invariant  singu¬ 
larly  perturbed  system 

,v 

*»A0x+  £  AotZj.  x|0)  =  .ko  (1) 

i- 1 
V 

e,ii ,■  =  A,0x  +  Y.  Auzp 

i- ' 
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where  xeR"\  z^R*1.  The  small  positive  scalars 

6, . eN  are  ordered  as  components  of  a  vector 

ee  R;V.  A  reduced  order  system  is  formally  ob¬ 
tained  by  setting  £-0  in  (2), 

X  =  ■¥  A0fZ,  *(0)~xo  (3) 

0=*AfOx  +  Afz,  (4) 

where  the  matrices  A0 /,  A/0  and  Af  are  formed 

of  the  submatrices  A0(,  Ai0  and  AtJ,  i,  j  *  1 . 

N,  respectively,  and  z' =(z[,  .  .  z'N).  Assuming 

that  Af  is  nonsingular,  (4)  has  a  unique  root 

i»-AJ1Af0x  (51 

whose  substitution  into  (3)  yields  (fee  reduced 
system 

x  =  (A0—A0fAf  lAfo)x  —  Arx,  x(0)*xo.  (6) 

The  task  of  singular  perturbation  is  to  find  under 
what  conditions  can  the  properties  of  the  so¬ 
lution  of  ate  original  system  (1),  (2)  be  deduced 
from  the  properties  of  the  solution  of  the  re¬ 
duced  system  (6).  Under  the  additional  assump¬ 
tion  that  s, *  ,/e,  — *0  as  ||e||— 0,  the  system  (1).  (2) 
exhibits  N  fast  time  scales,  that  is  Cj*,  is  fast 
relative  to  zt.  Such  multitime  scale  systems  are 
treated  by  nested  single  parameter  perturbations 
(Hopensteadt,  1969).  In  this  paper  we  treat  sys¬ 
tems  in  which  the  parameters  are  of  the  same 
order  and  do  not  allow  the  multitime  scale 
assumption.  We  therefore  assume  that  the  ratios 
of  «,....,£„  are  bounded  by  some  positive 
constants  m(J,  Mip 

— Si  A?(/,  i,j  -  1 . iV.  (7) 

£i 

that  is  the  possible  values  of  e  are  restricted  to  a 
cone  WcR*.  Previously,  singularly  perturbed 
control  problems  with  several  small  parameters 
of  the  same  order  have  been  treated  (Kokotovic, 
O’Malley  and  Sannuti,  1976)  by  reformulating 
the  problem  as  a  single  parameter  problem.  This 
is  done  by  expressing  the  small  parameters  e,.  e;. 

.  .  .,  £  v  as  known  multiples  of  a  single  parameter 
ft,  The  main  limitation  of  such  scalari- 

zation  is  that  the  results  depend  on  the  scaling 
coefficients  ft,  which  are  often  unknown.  The 
validity  of  the  result  is  restricted  to  a  ray  in  the 

space  of  s, . ev,  defined  by  a  particular  set  of 

values  P{ . ftv.  Even  if  the  solution  of  the  full 

problem  (1),  (2)  converges  to  the  solution  of  the 
reduced  problem  (6)  as  e— 0  along  every  ray  in 
the  cone  H,  this  is  not  sufficient  for  convergence 
as  £-»0  along  any  arbitrary  path  in  H. 


In  a  truly  muiuparumcier  problem  the  per¬ 
turbations  of  the  vector  e  are  not  limited  to  a 
particular  ray.  Convergence  results  are  sought  as 
||e||-»0  in  H,  which  guarantees  that  they  hold  for 
all  sufficiently  small  seH.  We  start  by  rewriting 


system  (1),  (2)  in  a  form  resembling  a 
parameter  system 

single 

x  »  A0x  +  A0  fz,  x(0)-xo 

(8) 

n(e)t»D(e)lAf0xA-Afz],  r(0)  =  :o 

(9) 

but  which  differs  from  a  single  parameter  prob¬ 
lem  because  both 

/I=^(£)  =  (£IS2...«v)1  "* 

(10) 

D  =  D(e)  =  block-diag  —  II . — 

Le\  fv  j 

(ID 

depend  on  all  £f.  It  is  crucial  that  in  view  of  (7) 
the  elements  of  D  are  bounded 

V£6  H,  i  =»  1 . TV  (12) 

£i 

where  m„  depend  on  mtJ  and  .Vfi(  in  (7). 
From  single  parameter  problems  we  know  that 
we  need  a  boundary  layer  system  to  correct  the 
effect  of  the  discrepancy  between  5(0)  and  the 
initial  value  :0  of  z.  In  the  multiparameter  prob¬ 
lem  we  define  the  boundary  layer  system  as 

~^D{E)Af^x),  5(0)  ~  ;0  —  5(0)  (13) 

where  tw/ji  is  a  ‘stretched’  time  scale.  The  right 
hand  side  of  (13)  depends  on  £  through  D[t:\ 
whose  elements  are  bounded  by  (12)  but  other¬ 
wise  arbitrary.  In  contrast  to  the  multitime  scale 
problem,  in  this  case  the  fast  modes  of  all  z,' s  are 
in  the  same  time  scale.  As  in  the  single  parameter 
problem  here  also  we  need  to  guarantee  the 
asymptotic  stability  of  the  fast  modes  for  all 
sufficiently  small  ceH.  that  is 

Rex(O(£)/4r)<0.  Veeff.  (141 

However,  in  the  single  parameter  problem  Die) 
*/  and  only  one  test  of  A(.4 f )  is  needed.  The 
main  difficulty  of  the  multiparameter  problem  is 
that  (14)  must  be  tested  for  every  es/f  whtch 
requires  solving  infinite  number  of  eigenvalue 
problems.  Our  approach  is  to  find  classes  of 
matrices  Af  for  which  (14)  is  satisfied  for  all 
diagonal  matrices  D  of  the  type  (11).  (12).  In 
Khalil  and  Kokotovic  (1979)  we  have  identified 
block  D-stable  matrices  as  an  important  class 
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satisfying  (14)  for  arbitrary  bounds  m,>  0,  Af, 
<  x.  A  matrix  Af  is  said  to  be  block  0-stable  if 
ReMDAf)<0  for  all  D~block-diag  [x,/„  .  . 
atv/ v]  with  arbitrary  positive  scalars  a,.  Further 
discussion  of  this  notion  and  an  alternative  char¬ 
acterization  of  a  class  of  matrices  satisfying  (14) 
is  given  in  Section  4. 

In  the  following  theorem  we  establish  stability 
properties  of  the  original  system  (IX  (2)  from  the 
stability  of  the  reduced  system  (6)  and  the  appro¬ 
ximation  of  the  original  solution  x,  z  by  the 
reduced  solution  x,  z. 

Theorem  1:  If  (14)  is  satisfied,  then  for  every 
finite  T>  0  there  exists  a  positive  scalar  v  such 
that,  for  all  re[0,  T]  and  all  ssff,  0<|je||£t\ 

x(t)-.x(t)+0(||e||)  (15) 

--</)=  —  Af  l<4/ox(Z)+z(T)+0(||e||),  (16) 

that  is  the  solution  of  the  original  problem  (1), 
(2)  is  approximated  by  the  solution  of  the  re¬ 
duced  problem  (6)  and  the  boundary  layer  prob¬ 
lem  (13).  If,  in  addition,  ReA(/tr)<0  then  (15), 
(16)  hold  for  all  T>  0,  and  the  original  system  is 
asymptotically  stable. 

A  proof  of  this  result  is  given  in  Khalil  and 
Kokotovic  (1979). 


.  (20) 

A v.i i  •••  Av, v  -J 
£ji  +  •  ••  ■'“Tv.*)-  (21) 

To  clarify  the  fact  that  Ek  can  be  nonsingular  for 
one  ordering  and  singular  for  another  ordering  we 
consider  for  example  the  case  N  -2,  n,  -n2  =  1  with 
/4m  *0,  Al2  =  l,  Au  =»  -1,  .4:2=  -1-  When  s2/£, 
-‘0  the  system  ( 1 X  (2)  possesses  two  fast  time 
scales.  In  contrast  the  limit  e,/a2-» 0  does  not 
result  in  two  fast  time  scales  since  cannot  be 
eliminated  from  the  equations  when  s,  =*0. 

With  the  assumed  ordering,  ReA(/tr)<0  and 

ReA(£k)<0,  k*l,...,N  (22) 

form  a  set  of  sufficient  conditions  for  asymptotic 
stability  of  (1),  (2).  The  following  theorem  gives  a 
relation  between  block  D-stability  and  condition 

(22). 

Theorem  2.  If  Af  is  block  D- stable,  then 
condition  (22)  holds  for  every  block  permutation 

of  Af  for  which  ReA(£*)^0,  k- 1 . N. 

Proof.  We  first  recall  an  eigenvalue  property  of 
the  single  parameter  singularly  perturbed  system 
with  a  small  scalar  parameter  v 


3.  BLOCK  D-STABILITY  AND  MULTJTIME  SCALES 
A  block  0-stable  matrix  Af  satisfies  (14)  for 
arbitrary  bounds  m„  Af,.  Hence,  we  can  extend 
the  set  H  to  the  cone  e,  >0  by  letting  m,-*0  and 
M(—x,  while  still  having  asymptotically  stable 
boundary  layer  system  (13).  Since  the  set  e,>0 
covers  the  regions  of  multitime  scale  pertur¬ 
bations,  one  would  think  of  block  D-stability  as  a 
more  restrictive  condition  than  the  boundary 
layer  stability  in  a  multitime  scale  problem.  Let 
us  examine  this  relationship. 

To  state  the  sufficient  conditions  for  asymp¬ 
totic  stability  of  the  multitime  scale  problem 
derived  in  Hoppensteadt  (1969),  we  assume  that 

the  parameters  . eN  in  (1),  (2)  are  ordered 

such  that  €j+ 1  /fij  — » 0  as  ||«||-*0,  that  is  ss  is  the 
smallest  parameter.  This  ordering  shows  which 
matrices  must  be  nonsingular  to  eliminate  the 
variables  Zj  as  the  parameters  s,  are  successively 
set  equal  to  zero.  For  the  adopted  ordering  ev, 

Sy  . . .  the  nonsingularity  is  required  for  the 

matrices 

Ek  =  Aik-ElkE-lk'En,  fc-  1 . S  —  1  (17) 

Ey  “  4  V.V  (18) 

where 

£i»”(-4*.**!-4*.*--2'--/U..v)>  (19) 


J>i=Fuy,+F12y2  (23) 

vJ'2=Jr:i>’i+F22>’2  -  (24) 

Lemma:  If  ReA  (F, ,  —  F,  2  FJ2  F21 )  <=  0. 
ReA(F22)*0  then  there  exists  v*>0  such  that  for 
all  ve(0,  v*]  the  eigenvalues  of  (23),  .(24)  have 
negative  real  parts  if  and  only  if 

ReA(Fu -F12FJ2'F21)<0.  ReA(F22)<0.  (25) 

To  prove  Theorem  2  we  first  consider  the  two- 
parameter  case  IV  =  2.  Block  D-stability  implies 
that 


holds  for  sufficiently  small  e2/e,.  When  Mn 
-  4 j  2 /1 22 .4 2 1 ),  A:2  have  no  eigenvalues  with 
zero  real  parts,  it  follows  from  the  lemma  that 

ReMAu-Al2A22'A2l)<0,  ReA(-422)<0.  (27) 

which  proves  Theorem  2  for  N  =  2.  For  N  >  2,  we 
can  show  that  block  D-stability  implies  (22)  by 
nested  application  of  the  lemma.  Noticing  that  if 
Af  is  block  D-stablc  so  is  P’ArP  for  ail  block 
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permutation  matrices  P  of  comparabie  block 
dimensions,  it  follows  that  (22)  must  be  satisfied 
for  each  ordering,  provided  Re/(£k)^0,  k  =  1 . 

N. 

Remark  1:  Asymptotic  stability  of  the  multipa- 
rameter  problem  with  arbitrary  bounds  mf>0, 
Mi<Xi  implies  asymptotic  stability  of  the  mul¬ 
titime  scale  problem  for  all  possible  orderings  of 
the  smallness  of  the  parameters. 

Remark  2.  Condition  (22)  is  a  necessary  con¬ 
dition  for  block  D-stability.  That  (22)  is  not 
sufficient  is  clear  from 

r-1  0  27  ~ | 

Aj*  I  —1  —1  0  I,  n2*n3  — 1. 

L  o  -i  -iJ 

The  matrix  Af  satisfies  (22)  but  it  is  unstable. 

Remark  3.  If  for  some  ordering  some  of  the 
matrices  Ek  have  zero  real  part  eigenvalues,  then 
(22)  is  no  longer  necessary.  Consider  again 

_jj,  IV- 2,  /1,-nj-l 
in  which  Af  is  D-stable,  while  (22)  is  not  satisfied. 


4.  CONDITIONS  FOR  BOUNDARY  LAYER  STABILITY 

The  most  difficult  part  in  the  multiparameter 
problem  is  verifying  that  As  satisfies  (14)  for 
some  given  bounds  m„  Mt  in  (12).  Since  Block  D- 
stable  matrices  satisfy  (14)  with  arbitrary  m,>  0, 
Mt<x,  one  may  start  by  testing  whether  Ar 
satisfies  some  block  O-stability  condition.  If  Af  is 
block  D-stable.  then  the  problem  is  solved. 
However,  when  Af  does  not  satisfy  the  necessary 
condition  for  block  D-stability  given  in  Section  3, 
or  if  it  satisfies  the  necessary  condition  but  does 
not  satisfy  any  of  the  known  sufficient  conditions, 
this  does  not  mean  that  Af  does  not  satisfy  (14) 
for  the  given  bounds.  In  fact,  in  most  multipara¬ 
meter  problems  of  interest  the  small  parameters 
£t,  .  .  .,  ev  are  of  the  same  order  of  magnitude. 
Hence  the  bounds  m„  M,  are  close  to  one.  In  this 
case  the  class  of  block  D-stable  matrices  is  a  very 
conservative  subclass  of  the  class  of  matrices 
satisfying  (14)  for  the  bounds  given  in  the 
problem. 

Our  task  in  studying  conditions  for  boundary 
layer  stability  is  two-fold.  On  one  hand  we  need 
sufficient  conditions  for  block  D-stability.  The 
more  we  know  about  block  D-stability.  the  more 
readily  we  can  employ  it  to  verify  the  boundary 
layer  stability  of  Af.  On  the  other  hand  when 
block  D-stability  tests  fail  we  need  conditions 
that  make  use  of  the  particular  bounds  given  in 


/ 

the  problem.  For  the  rest  of  this  section  we 
discuss  these  two  approaches  and  illustrate  them 
by  electrical  network  examples. 

The  block  D-stability  property  of  matrices  is 
an  extension  of  the  concept  of  D-stability.  If  Af  is 
partitioned  in  scalar  blocks,  that  is  if  n,-l,  then 
the  block  D-stability  is  merely  D-stability. 
Economists  have  studied  this  notion  for  several 
years  and  have  formulated  several  sufficient  con¬ 
ditions  which  are  surveyed  in  Johnson  (1974).  In 
Khalil  and  Kokotovic  (1979)  we  examined 
Siljak’s  (Siljak,  1977)  and  Michel's  (Michel  and 
Miller,  1977)  interconnected  asymptotically  stable 
subsystems.  Here  we  show  that  their 
decomposition-aggregation  method  can  be  used 
to  test  block  D-stability  and  generate  sufficient 
conditions  which  encompass  as  special  cases  the 
two  tests  reported  in  Khalil  and  Kokotovic, 
(1979).  The  matrix  Af  is  viewed  as  an  intercon¬ 
nection  of  the  isolated  subsystem  matrices  Au 
through  the  interconnections  A,j,  i^j.  When 
ReA(AH)<0  one  may  construct  a  sufficient  con¬ 
dition  for  ReA(/tr)<0  by  limiting  in  some  sense 
the  interconnections  Atj.  In  large  scale  system 
literature,  Lyapunov  methods  have  been  used  to 
construct  such  conditions.  Let  t>,  be  a  Lyapunov 
function  for  the  i-th  subsystem.  Siljak’s  approach 
is  to  form  a  vector  Lyapunov  function  whose 
components  are  £>,.  Michel’s  approach  is  to  use  a 
weighted  sum  of  »lt  .  .  .,  vs  as  a  new  scalar 
Lyapunov  function.  We  are  going  to  show  that  if 
a  matrix  Ar  with  ReAf/lJcO,  1*1, .  . .,  N,  can  be 
shown  to  be  stable  using  either  Siljak’s  or 
Michel’s  approach,  then  Af  is  also  block  D- 
stable. 

Suppose  that  the  time  derivative  of  v(  along  the 
trajectory  of  the  interconnected  system  can  be 
majored  by  the  inequality 

,v 

ti %<°,  su s£°  (28) 

!•  1 

for  some  scalars  stJ.  Introducing  the  vector 
Lyapunov  function  v  we  rewrite  (28)  as  eg  Sr. 
Then  using  the  comparison  principle  (Siljak, 
1977)  it  follows  that  a  sufficient  condition  for 
ReA{4/ }  <0  is  that  S  be  an  M-matrix.  Now 
suppose  that  Af  is  multiplied  by  D  =  block- 
diagOi/,,  ■  ■  -  **!*]•  Choosing  the  same  v  as 
above  we  get  that  egDSe  where  D=diag[x,,  .  .  ., 
Xy],  Since  multiplying  an  A/-matrix  by  a  diagonal 
matrix  with  positive  entries  does  not  change  its 
status  (Siljak.  1977),  it  follows  that  DS  is  an  .Vf- 
matnx.  hence  DAf  is  stable.  Alternatively,  let  the 
new  scalar  Lyapunov  function  be  c-£;v„ ,  ftrjt 
where  p,> 0.  Suppose  there  exist  numbers  /?,  such 
that  the  time  derivative  of  v  is  negative  definite, 
than  ReAj^/}<0.  Now  multiply  Ar  by  D. 
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Choosing  c— (ft/a,)^  as  a  Lyapunov  func¬ 
tion,  we  find  that  the  time  derivative  is  the  same 
as  before.  Hence,  Rex{D,4f’ <0  for  any  >0. 
Subsequently  Af  is  block  D-stable. 

When  the  bounds  m,,  Mt  in  (12)  are  given  finite 
numbers,  the  class  of  matrices  Af  satisfying  (14) 
is  less  conservative  than  the  class  of  block  D- 
stable  matrices.  However,  the  search  for  sufficient 
conditions  may  be  more  difficult.  Our  problem  is 
to  find  sufficient  conditions  for  aymptotic  stabi¬ 
lity  of  a  family  of  linear  systems  y**DAfy  where 
D  is  function  of  the  parameter  vector  a*(a„  .  .  ., 
av).  The  set  A  of  allowable  at  is  a  convex  polyhedron 

A»{at:4Sjat^a,as/?iV}  (29) 


turbations.  Are  all  the  passive  networks  0-stable? 
If  so  do  they  satisfy  the  known  sufficiency 
conditions? 

We  consider  first  the  case  when  Af  is  the 
matrix  of  a  passive  RLC  network  without  coup¬ 
ling  between  inductors.  We  are  going  to  show 
that  if  the  network  is  asymptotically  stable,  that 
is  if  Rc/.(A/)<0  then  As  is  O-stable.  Let  us 
assume  that  the  network  has  n,  inductors  and  nc 
=  Znf-n,  capacitors.  A  standard  choice  of  the 
state  variables  is 

Xj » current  through  i-th  inductor,  when  i«l, .  .  ., 

"i 

=  voltage  through  y'-th  capacitor,  when  y=-n, 
+ 1, . . .,  In,. 


where  3,  i  are  constant  vectors  depending  on  mh 

Mh  i  =  1 . 1 V,  and  the  inequality  is  understood 

to  be  component-wise.  We  denote  by  at,n,  a|2>, 
. . .,  the  2,v  vertices  of  A,  and  the  corresponding  D 
matrix  by  D(i)  =  block-diag  (a*,0/ xjj'/y).  We 
notice  that  the  elements  of  DAr  are  linear  func¬ 
tions  of  i  For  this  stability  problem  it  has  been 
established  in  (Horisberger  and  Belanger,  1976) 
that  a  sufficient  condition  for  DAf  to  be  stable 
for  all  as  A  is  the  existence  of  a  symmetric 
positive  definite  matrix  P  such  that 

PDut  Af  +  A'f  D<‘’P  <0,  i'—l,2 . 2N.  (30) 

This  condition  requires  that  the  same  P  satisfies 
(30)  for  all  vertices  and  in  its  present  form  is  not 
finitely  verifiable,  that  is  there  is  no  algorithm 
with  a  finite  number  of  steps  to  verify  the  exis¬ 
tence  of  P.  However,  the  situation  is  greatly 
helped  by  the  following  result  (Horisberger  and 
Belanger,  1976),  which  reduces  the  test  of  (30)  to 
a  convex  minimax  problem  with  linear  con¬ 
straints. 

Lemma.  Assume  that  at  least  one  of  the  DiUAf 
is  known  to  be  stable,  then  there  exists  a  P  =  P' 
>0  such  that  (30)  is  satisfied  if  and  only  if 

min  {  max  ij,(P)}<0  (31) 

nni<t  i-i. j . 2* 

where  y((P) */^PD,i’/l/  -t-  A’fDU]P)  for  all  real 
symmetric  matrices. 

5.  ELECTRICAL  NETWORK  EXAMPLES 

AH  the  above  conditions  attempt  to  delineate 
classes  of  systems  for  which  no  physically  mean¬ 
ingful  combination  of  parameter  perturbations 
will  exist  causing  instability.  As  a  well  known 
example  of  such  systems  consider  passive  electri¬ 
cal  networks  which  remain  stable  for  all  positive 
values  of  R.  L.  C-parameters  and  therefore  cause 
no  difficulties  with  muitiparameter  singular  per¬ 


Then  the  state  space  equation  takes  the  form 
(Kalman,  1963) 


Tx  —  Ax 


(32) 


where 


ft  a  -ft  a 


Here  L  is  a  diagonal  matrix  whose  positive 
diagonal  element  Lu  is  the  value  of  the  i-th 
inductor,  and  C  is  a  diagonal  matrix  with  Cn 
being  the  value  of  the  y-th  capacitor.  The  matrix 
A  does  not  depend  on  the  values  of  the  inductors 
or  the  capacitors.  It  depends  only  on  the  network 
configuration  and  the  values  of  the  passive  re¬ 
sistors.  The  matrices  4,  and  A2  are  symmetric 
negative  semidefinite. 

Let  us  assume  that  this  network  is  asymptoti¬ 
cally  stable  and  recall  that  this  property  does  not 
depend  on  particular  values  of  L  and  C,  but 
solely  on  the  presence  of  the  resistors  as  dissi¬ 
pative  elements.  In  other  words  if  a  network  is 
asymptotically  stable  for  one  set  of  L,  C  values,  it 
will  remain  asymptotically  stable  for  any  set  of 
physically  meaningful  values  of  L  and  C.  From 
the  form  of  the  system  (32),  we  observe  that 
changing  values  of  L  and  C  is  equivalent  to 
multiplying  the  system  matrix  from  the  left  by  a 
diagonal  matrix.  The  preservation  of  asymptotic 
stability  under  this  operation  is  the  D-stability. 
Thus  the  network  matrix  4/=*7"~  ‘4  is  O-stable 
and  therefore  block  D-stable.  However  it  is  easy 
to  show  that  such  a  network  does  not  have  to 
satisfy  any  of  the  sufficient  conditions  of  D- 
stability  given  in  Johnson  (1974)  or  Khalil  and 
Kokotovic  (1979).  An  example  is  the  network  in 
Fig.  1  whose  4,  and  42  are  negative  semidefinite 
and  whose  matrix  A,  is  D-stable.  but  for  which 
the  known  sufficiency  tests  fail. 

Another  interesting  observation  is  that  if  the 
network  contains  mutual  coupling  between  in- 
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ductors,  then  Af  is  not  necessarily  D-stable.  For 
example  the  network  in  Fig.  2  has 


has  ReA(>4  f )  <  0  for  1/2  <  L/C  <  x . 
(33) 


which  is  not  D-stable.  The  reason  is  that  for  the 
case  of  mutual  coupling  the  matrix  L  becomes  a 
positive  definite  symmetric  matrix  instead  of  be¬ 
ing  diagonal  as  in  the  case  without  mutual 
coupling.  Multiplying  Af  by  a  diagonal  matrix, 
which  is  equivalent  to  multiplying  L  by  a  dia¬ 
gonal  matrix,  results  now  in  a  nonsymmetric 
matrix  and  hence  cannot  be  interpreted  as  chan¬ 
ging  the  values  of  inductors  and  capacitors.  A 
special  case  is  when  mutual  inductive  coupling 
exists  within  each  subnetwork,  but  there  is  no 
inductive  coupling  between  different  subnetworks. 


1 


Fig.  1. 


Fig.  2. 


The  matrix  T of  such  a  network  takes  the  form 


r  *  1 


Fig.  3. 

6.  APPLICATION  TO  CONTROL  AND  GAME 
PROBLEMS 

The  problem  to  optimally  control  the  system 

s 

x  *  A0x  +  £  A0jZj  +  B0u,  x(0)*x„  (36) 

.i-i 

v 

£,i,  *  Al0x  +  £  AtjZj  +  Btu,  2,(0) »  z,q  (37) 
3-i 

with  respect  to  the  performance  index 

J=tfo(y'y+u'Ru)dt,  R> o  (38) 

where 

y~C0x  +  £  CjZj.  (39) 

>*  • 

is  interpreted  as  a  perturbation  of  a  reduced 
problem 

x  =  A0x  +  A0/z  +  B0u  (40) 

0*  Af0x  +  AfZ  +  BfU  (41) 

y  =  C0x  +  Cfz  (42) 


T =  block-diagf  T„...,  T*],  (34) 

where 


Multiplying  Af  by  a  diagonal  matrix  of  the  form 
D  —block-diag[x,/  is  equivalent  to 

multiplying  L<,  C,  by  a„  which  is  merely  scaling 
of  the  Land  C  elements  of  the  i-th  subsystem  by 
a,.  Thus  the  matrix  representation  of  such  a 
network  is  block  D-stable. 

Finally,  if  the  network  is  not  passive  then  Af  is 
no  longer  block  D-stable  if  Rex(A/)<0  for  some 
values  of  Land  C.  However,  Af  may  still  satisfy 
the  boundary  layer  stability  condition  for  some 
finite  bounds.  Consider  for  example  the  active 
network  in  Fig.  3,  whose  matrix 


in  which  e=»0  and  the  matrices  Bf,  Cf  are 

formed  of  the  submatrices  Bt,  C„  i  =  l . N, 

respectively.  Assuming  that  Af  is  nonsingular  z  is 
solved  from  (41)  and  eliminated  from  (40),  (42) 
and  (38).  Then  the  reduced  problem  is  to  op¬ 
timally  control  the  system 

x  =  A^  +  B,u  (43) 

with  respect  to 

Jr  =  iSo(x'C;Crx  +  2u£;cr*  +  u'Rru)dt  (44) 

where 

Ar  m  Ao  ~  A0{  Af  1  Aj-0,  B,»  B0  —  A0j-Af  1  Br, 
Cr*C0-CfAJ'Br,  Er~-CfAj'B, , 

+  E/E,. 


(45) 
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The  reduced  problem  (43),  (44)  is  considerably 
simpler  than  the  original  problem  (36M38)  be¬ 
cause  of  the  elimination  of  the  fast  variables  and 
the  reduction  of  the  system  order.  One  of  the 
tasks  of  the  singular  perturbation  analysis  is  to 
establish  whether  the  full  problem  is  well-posed 
in  the  sense  that  its  solution  tends  to  the  solution 
of  the  reduced  problem  as  e—0  in  H.  If  so,  then 
the  next  task  is  to  use  the  solution  of  the  reduced 
problem  as  a  basis  for  a  simplified  design 
procedure. 

If  the  triple  (A„  B„  Cr)  is  stabilizable- 
detectable,  then  the  optimal  control  for  the  re¬ 
duced  problem  is  (Chow  and  Kokotovic,  1976) 

u~-Rr~'(E'rCr  +  B'JCr)x  (46) 


K,(fi)«K,  +  0(||e||)  (52) 

**(£)-*„,(«) +0(||e||)  (53) 

KjW-K/W+OflHI)  (54) 

where  Kr  is  the  positive  semidefinite  solution  of 

(47), 

Km  -  [K,(B0K  - 1  B'j  D(e)Kf(s)  -  A0/ ) 

-(. A',0D(e)K/e)+C0C, )] 

•  [D(e)Af  -  D(e)BfR  '  lB'fDWf(e)}  " 1  (55) 

and  Kf[e)  is  the  positive  semidefinite  solution  of 

the  Riccati  equation 


where  Kr  is  the  unique  positive  semidefinite  so¬ 
lution  of  the  Riccati  equation 

KMr ~ BA'  lE'Cr)  +  (A, - BrR~ 1 ErC,YKr 
-KJrR;  lB’JC,  +  c;(/  -  E^-  lE’r)C,  =  0.  (47) 

On  the  other  hand,  the  optimal  control  for  the 
original  problem  is 


where  K  is  the  stabilizing  solution  of  the  Riccati 
equation 

KA  +  AK  +  CC-KSK=0  (49) 


S3d,iM' 


C.[C,  c,l  SmBR-‘r.  (50) 

To  avoid  unboundedness,  the  solution  of  (49)  is 
sought  in  the  form 


K-KIsn 


K,(e)  *i(e)K2 


The  asymptotic  behavior  of  K  as  s-»0  is  given  in 
the  following  theorem. 

Theorem  3.  If  A,  satisfies  (14)  and  M„  B„  C, )  is 
stabilizable-detectable,  then  for  all  sufficiently 
small  s  e  H 


Kf(e)D(e)A,  +  A'fD(e)Kf{e) 

+  C'f  Cf—Kf  (e)D(e)B  f  R~lB'fD{e)Kr{B) 


The  proof  is  given  in  Appendix  A.  We  notice 
that  since  for  every  eeH  the  matrix  D(e)/1/  is 
stable,  the  Riccati  equation  (56)  has  a  unique 
positive  semidefinite  stabilizing  solution  Kf(e). 
Thus  the  matrix  D(e){Af-BfR~lB'fD(e)Kf(e))  is 
stable  and  its  inverse  in  (55)  is  well-defined. 

When  e  is  scalar  the  limiting  values  of  X2,  X3 
are  not  dependent  on  e  (Chow  and  Kokotovic, 
1976).  In  contrast,  we  see  from  (53),  (54)  that  in 
the  multiparameter  problem  the  limiting  behavior 
of  K2  and  K3  depends  on  e,  and  hence  on  the 
particular  path  along  which  e-»0.  However,  it  is 
seen  from  (51)  that  both  K2  and  K3  are  multi¬ 
plied  by  p(£)  which  tends  to  zero  as  £-»0. 
Therefore,  the  part  of  K  that  is  crucial  as  £—0  is 
only  K,(e)  which  tends  to  the  solution  of  the 
reduced  problem  Kr  as  e-*0  along  any  arbitrary 
path  in  H.  In  other  words,  the  optimal  value 
function  of  the  full  problem  •f<,p,:*i[x0/r0]' 
K[x0/z0]  tends  to  the  optimal  value  function  of 
the  reduced  problem  Jr^**$x0Krx 0  as  £—0  in  H. 
Thus,  the  optimal  solution  of  the  full  problem  is 
well-posed.  The  next  theorem  utilizes  this  well- 
posedness  property. 

Theorem  4.  If  A{  satisfies  (14)  and  (.4^  Br,  Cr ) 
is  stabilizable-detectable,  then  the  use  of  the  re¬ 
duced  control 

“r “  ~ 1  (£’ Cr  +  B^Kr)x  (57) 

results  in  J  satisfying 

-f =■(«,, +  0(|M|).  Vsetf.  (58) 

Theorem  4  is  proved  in  Appendix  B. 

Remark  4.  The  reduced  control  (57)  does  not 
require  knowing  the  values  of  the  parameters  £,,  . 
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.  .,  ev.  Thus  it  is  suitable  for  cases  when  e„  .  . 
ev  are  small  uncertain  parameters  taking  values 
in  H. 

Remark  5.  In  the  single  parameter  optimal 
control  problem  (Chow  and  Kokotovic,  1976)  it 
is  possible  to  achieve  0(ej)  approximation  of  the 
optimal  value  of  the  performance  index  without 
knowing  the  value  of  e.  This  is  done  by  adding  to 
the  reduced  control  (57)  another  term  which 
accounts  for  the  optimization  of  the  fast  modes. 
An  analogous  possibility  does  not  exist  in  the 
multiparameter  problem  because  such  a  term 
would  involve  Kf(e),  which  requires  the  know¬ 
ledge  of  e.  Even  if  the  value  of  £,  say  e0,  is  known 
and  Kf  is  evaluated  at  £0,  the  matrix  [D(e)Af 
-  D{e)Br  D{E]Kf(e0)]  is  not  necessarily 
stable  for  all  £  e  H.  This  means  that  including  K f 
in  the  control,  limits  its  validity  to  small 
variations  of  £  around  £0. 

Remark  6.  The  intuitive  result  of  Theorem  4 
should  not  be  surprising  to  people  familiar  with 
the  regulator  problem.  However,  it  should  be 
noticed  that  this  result  is  a  consequence  of  the 
well-posedness  of  the  optimal  control  problem 
and  it  is  no  longer  true  for  ill-posed  problems. 
We  illustrate  this  by  discussing  Nash  games. 

In  the  design  of  multi-input  control  problems, 
the  objectives  in  the  optimal  policy  may  be  met 
by  formulating  the  control  problem  as  a  differen¬ 
tial  game.  In  a  game  where  cooperation  among 
the  players  cannot  be  guaranteed,  a  solution  is 
the  Nash  equilibrium  strategy.  For  the  multipara¬ 
meter  singularly  perturbed  system 

x  =  A0x  +  A0f:  +  B0lul+B02u2,  x(0)  =  xo  (59) 

a(s)i  =  D{e)(A/0x  +  A f  z  +  Bf  ju,  +  Bj2u2).  z|0)  =  r„ 

(60) 

the  i-th  player  chooses  his  strategy  u,  to  minimize 
his  performance  index 

dr, 

Rtl  >  0,  i*  1,2.  (61) 

A  Nash  equilibrium  solution  of  this  game  is  a 
pair  (u*.  u*)  such  that 

Ji{u?,uf)£Ji(ui,uf),  i*j,  i*  1,2  (62) 

We  discuss  here  the  closed-loop  linear  solution  of 
the  two  player  game  (59H61)  which  is  given  by 
(Starr  and  Ho,  1969) 

1-1,2 


where  (Kt>  K2)  is  a  solution  of  the  coupled 
algebraic  Riccati  equations 

0 =KfA  +  A’Kt  +  Qt -K.BtRa  1  B|K, 
-K,B,R;W,-KlBiRT,'VfLl 

-KlB,R,,'R,,Rn'B]Kr 

/=/.  /./  =  1.2.  (64) 

such  that  ReA(A - B , R f,1  B\Kl  - B2R22l B‘2K 2)<0. 
The  matrix  A  is  as  in  (50),  B',  =  (B’0i 
(l/n(e))B'fiD(E))  and  K.-K^e)  is  sought  in  the 
form  (51). 

Closed-loop  solutions  of  singularly  perturbed 
Nash  games  when  s  is  scalar  have  been  in¬ 
vestigated  in  (Gardner  and  Cruz,  1978).  It  turns 
out  that  setting  e=0at  two  different  stages  leads 
to  different  solutions.  This  means  that  setting  £ 
=  0  in  the  original  problem  to  obtain  a  reduced 
problem  and  solve  it  is  in  general  different  from 
solving  the  original  problem  first  and  then  setting 
£  =  0.  The  reason  of  this  phenomenon  has  been 
discussed  in  Khalil  (1978)  and  we  briefly  sum¬ 
marize  it  here.  The  necessary  conditions  for  a 
Nash  solution  (Starr  and  Ho,  1969)  depend  on 
the  partial  derivatives  fu./fx.  <'u,/fr.  Therefore 
the  Nash  game  unlike  the  optimal  control  prob¬ 
lem  has  different  open-loop  and  closed-loop 
solutions.  When  the  Nash  game  is  singularly 
perturbed  the  difference  in  the  solutions  obtained 
by  setting  e  =  0  at  two  different  stages  is  due  to 
the  partial  derivative  dujdz.  Setting  £=0  to  ob¬ 
tain  a  reduced  problem,  one  eliminates  z.  Hence 
automatically  dujdz  is  set  equal  to  zero.  When 
the  original  problem  is  solved  first  and  then  £  is 
set  equal  to  zero  it  is  not  necessarily  true  that 
dujdz  is  zero.  Thus  one  should  not  expect  the 
closed-loop  solution  of  the  full  problem  to  tend 
to  the  closed-loop  solution  of  the  reduced  prob¬ 
lem  as  —0. 

In  the  multiparameter  Nash  problem  (when  e 
is  a  vector)  the  situation  is  richer.  We  first  give 
some  examples  and  then  discuss  the  asymptotic 
behavior  of  Kt,  K2  as  e-*0  in  H. 

Example  1.  Consider  the  system 


X=  -X  +  Z.+Zj 

(65) 

£tfj=  -z,+u, +2u: 

(66) 

£2  ^2  =  — ■  "2  ^  1  ^2 

(67) 

and  the  performance  indices 

1 

1 


(63) 


J,  -1  Jo  (x2  +  rf  +  z2  +  it;  )dt. 


(68) 
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We  solve  the  associated  coupled  algebraic  Riccati 
equation  (64)  where  K ,  takes  the  form 

K  I-*.. 

uKaj 

We  let  £-»0  along  different  paths.  For  simplicity 
we  take  the  paths  to  be  the  rays  e2/e,  =*0.25,  e2/e, 
=4.  The  limiting  values  of  #CM,  K2l  are  shown  in 
Table  1,  where  it  is  obvious  that  the  limiting 
behaviour  of  K,„  Kn  depends  on  the  particular 
path  along  which  £-»0. 


*2/el 

0.25 

l 

4 

Ku 

0.0785 

0.0827 

0.084 

K21 

0.3873 

0.3725 

0.3595 

Example  2.  Consider  the  system 

x=-.y  +  z,+z2  (69) 

«,Zj= -z.  +  u, +u2,  (=1,2  (70) 

with  the  performance  indices  as  in  (68). 

Solving  (64)  we  find  that  K,=K,  and 
limt_0K,1  =0.3777  as  £-.0  along  any  arbitrary 
path.  However  if  we  set  s,=e2=0  in  (70),  elim¬ 
inate  z  and  solve  the  resulting  reduced  game  we 
get  that  Klr-Klr~ 0.375  which  is  different  from 
lim,_0Kn. 

Example  3.  Consider  the  system 

x  =  rt-z,  (71) 

e.i,  =  —  z,  1- tij,  i=l,2.  (72) 

with 

(x2  +  z,2  +  uf).  (73) 

Solving  the  full  game  we  find  that  as  £—0  along 
any  arbitrary  path  K(I-*Kf,  =  v  2/3.  *  =  1,  2. 
where  Klr,  K2,  are  the  solution  of  the  reduced 
game. 

Example  1  shows  that,  in  general,  the  limit  of 
the  closed-loop  solution  of  the  full  Nash  game 
depends  on  the  path  along  which  e-*0.  Example 
2  shows  a  special  case  when  the  limit  does  not 
depend  on  the  path  but  it  is  different  from  the 
closed-loop  solution  of  the  reduced  game.  For 
this  case  one  may  try  to  define  a  reduced  prob¬ 
lem  whose  solution  is  the  limit  of  the  full 
solution,  as  in  the  single  parameter  case  I  Gardner 


and  Cruz,  1978).  Finally,  Example  3  shows  a 
well-posed  special  case  where  the  closed-loop 
reduced  solution  may  be  used  to  approximate  the 
closed-loop  full  solution  as  in  the  optimal  control 
problem.  Notice  that  in  the  three  examples  Ar  is 
D-stable.  Hence  control  problems  for  these  sys¬ 
tems  would  be  well-posed. 


6.  CONCLUSIONS 

The  basic  difficulty  in  extending  the  single 
parameter  singular  perturbation  techniques  to  the 
multi-parameter  case  is  in  testing  the  stability  of 
the  boundary  layer  system.  Although  block  D- 
stability  is  a  sufficient  condition  for  the  boundary 
layer  stability,  there  are  two  limitations  on  using 
it.  First,  we  still  do  not  have  a  complete  characte¬ 
rization  of  the  class  of  block  D-stable  matrices. 
Second,  for  most  problems  of  interest  block  D- 
stability  is  a  conservative  condition  and  more 
work  is  needed  to  develop  conditions  different 
from  block  D-stability  to  check  the  boundary 
layer  stability. 
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APPENDIX  A 

Proof  of  Theorem  3.  The  substitution  of  ($1)  into  (49)  yields 
the  equations 


X  |  A,,  +  AqK  i  +KjD4|Q-f  A^oDX,  +  C<jCo  ~K  [  S  'K  , 

-KlS1DK’i-K1DS'iKl-KlDSiDKJ~0  (Al) 
X,Ao/J“X,DA^  +  /iAqX,  +  A  ^qDK  j  +  CqC  f  ~~  fJC  ,  S,X, 

-K.SjDXj-^jDSiKj-XjDSjOK^O  (A2) 

/tXjAoy  +  fiAg/Ki  +KtDAr  +  AfDK3  +  C'fCf 

-/ijX',S,Xj -MfCi S2DKi~iiKiDS'JK ,  -X,DS,DX  ,  -0 

(A3) 

where 

St-Bo/T’Bi,  Sj-B0X"1®/  “d  Sj-B^R^'B). 

Let  X,.  Xj,  and  X,  satisfy  the  equations 

Xj  A„  +■  ApX  i  +K  jO^iq  +  A  jqDR.  j  +  C„Cq 

-X,S,X,  -R2S2DR\ -R1DS'JRi  -R2DS2DR'2=0  (A4) 

X,A0/ +*20/4, +  A)0d£j +  01)0/ -^SjDXj-XjDSjDXj-O 

(A5) 

X3DA/  +  A>DX3  +  C}C/-XiOSjDXj-0.  (A6) 

We  first  consider  the  solution  of  (A4HA6),  then  we  establish 
the  relation  between  X,  and  R,.  Under  assumption  (14), 
equations  (56)  and  (A6)  imply  that  £](c)-K/(e).  Hence 
solving  (A5)  for  X,  we  get 


R2  *  [X,(S,DX  /  —  Aoy)  —  (CoU|-  +-  Ar0DKj  )"][.DAf 
-OSsDKfyl 

•R,E,  -E2.  (A7) 

Substituting  (A7)  into  (A4)  results  in  the  Riccati  equation 

RJ  +  ARt  +  Q-RjR-'S'Ri-O  (A8) 

where 

A  *  Aq  +  E\DA fo  +  S2DE'2  +E,DS,DE'2  (A9) 

S-Bo  +  EtDBf  (A  10) 

^-CoCo-EjOA^-A  foDEi  —  E2DS  2DE2.  (A  1 1) 

Algebraic  manipulation  using  (56)  yields 

A-A.-B'R;'E:C,  (M2) 

6R-t6-BrR;‘B'r  (A13) 

(3  -  C‘,{l  -  E,Rf 1  E'rKr  (A14) 


Under  the  assumption  that  (A„  B„  C,)  is  stabilizable- 
detectable,  (47)  and  |A8>  imply  that  X,  «Xr.  Hence  R ,  is  not 
dependent  on  e.  From  (55)  and  (A7),  X,  »X„. 

Subtracting  (A4).  (AS),  and  (A6)  from  (Al),  (A2)  and  ( AJ), 
respectively,  and  using  that  the  elements  of  D  are  bounded  for 
ee  H.  we  find  that  AX,  -A,  -X,,  AX, »X, -X,.  AX,-X3 
-X)  satisfy  the  equations 


AX,  A,,,  +  AXjDA,  +  A)0DAXj  -  AX,S,DAX,  -X,SjDAX, 
-AX.SjDX,  -AXjDSjDAXj-AXjDSjDX, 

-  KmDS,DAK ,  +  0(||e||) »  0  (A16) 

AX,[DA,  -  BSjDX,]  +  [DA,-  -  BSjDX^'AX, 

-  AX  jDSjDAX,  +  O(||«||)”0.  (A17) 

From  (A17)  we  get  that  AX, » 0(|je|{>.  Then  from  (AI6)  we 
have 

AK,-AK,Et+0(||e||).  (A!?) 

Substituting  (A18)  into  (A15),  it  can  be  shown  that  AX, 
satisfies  the  equation 

ax,(a,-b^-  ‘e;c,-  B^r  1B'rxr)+(Ar-Brxr"  *e;c, 
-B^-'B^fAX,  -AX1BrR,-'B'fAXt  +O(||e||)-0,  (A19) 

Since  (A,  -  B^' 1 EJC,  -  B,R," 1  B^Cr)  is  stable  it  follows  that 
AX,  =0(||ej|),  hence  AX,-0{||£||). 


APPENDIX  B 
Proof  of  Theorem  4.  Let 

H~l  +  R',B'fDKf{Af-S1DKrr'Bf.  (Bl) 

It  can  be  easily  shown  that 

H" 1  —  R~ x  B’fDKj  Af'Br  (B2) 

R7'~HR-'H ■  (B3) 

B,H-fi=.B0+-E,DB/  (B4) 

A;'B/H  =  (A/-S,DX/)-,B/  (B5) 


H R  ■ 1  B>  D  =  R  -  '  B>  D[f  +X,  ( A,  -  S>DKf ) ‘ 1  S,Dl  (B6) 


Using  (B1HB6)  we  rewnte  (57)  in  a  more  convenient  form 
u,  -  [HR  -  1  H  B’jA’f  ■ 1  C'f(C0  -  C,  A/ 1 A/0)  -  HR  * 1  H’B'JC ,]x 

=  [HR-'B}(Ar-S}DK,)'-')CrC0+<K,DAr  +  A,,DKf 
—K rDS2DKr)Ar  *Ayo) 

-HR-'(B0  +  E,DBr)K,]x 

=  [HR-'B-f(Ar- SiDKrT -  ‘(C>C0  +K,DA,0) 

+  HR-'B‘rDKrAf'Ar0 

-  R  - 1  BiX,  -  R  - 1  B>  DKr(Ar  -S,DKfr'  S,Kr 
-HR-'B-fDE^Jx 

~-R-lB‘aKrx-HR-'BfD[Km  +  KrAJ'S2K, 

—KfAf  lAyo]x 


-  -  R' '  B'oKrX  -  R~  'B}D[I  +K f(A r  - S,DK f)~ ' S]D][K'm 
•(■KfAf  '(S,Xr  —  A^oJjx 


-R-‘ 


IB7) 


where 


AX,A,  +  A0AX,  i-AX:DA,0w  A>oDAX) -AX,S,AX, 
-AX,S:0AX,  -AXjOSjAX,  -AXjDSjOAX, 
-AX,S,Xr-K,S,AX1  -A X,S,DX. 


X,  - [X.  +  (XPS,  -  A}„)A>-  'K,!/  +  DS,( Ar  -  S,DK/ f  ‘  'XJ. 

(B8) 


When  u,  is  used,  the  value  of  the  performance  index  is 


-KJ)S ,AX,  - XrS, BAX',  —  AX jDS)X, 

-AX,DS,DK. -XJ)S,DAX,-0  (A151 


■CM:] 


IB9) 


.r  «r»raiywa| 
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where  W  is  the  positive  semidefinite  solution  of  the  Lyapunov 
equation 

W(A-SL)  +  (A-SLYW+LRL+Q-0.  (BIO) 

On  the  other  hand  the  optimal  value  is 


P.Mo  -  S,Kt  -  S1DK,)  +  (,(0  -  S,K,  -  SjZ>fC;)'P,  +  P,DM,  „ 

-  SiX,  -  S)DKt)  +  (Af6  -  S'2K,  - 

+(Km-Kp)DSiDiKm-K,Y  -0 

(B17) 

/t/0  -  -  S%DKr)’D  P,  +  <#C„ 

-Kp)DS2DKf-0  (B18) 

f’sDA/^A'/Dfi+K/DS3DK/mO.  (B19) 


where  K  is  the  stabilizing  solution  of  (49).  Subtracting  (49) 
from  (BIO)  we  find  that  V-W-K  satisfies  the  Lyapunov 
equation 


V(A- SL ) +{A- SL)‘V+  [K  - L)  S(K  - L) -0.  (B12) 


We  seek  Via  the  form  (51),  that  is 


V> 


KM 

MV'iM 


mMKM' 

rMKM. 


Substituting  (B13)  into  (B12)  yields  the  equations 


(B13) 


We  first  evaluate  P„  K,  and  Pj.  Since  A ,  satisfies  (14),  there 
exists  a  unique  positive  semidefinite  solution  P3  of  (B19). 
Expressing  P2  in  terms  of  P,  and  Pj,  substituting  in  (B17)  and 
using  (B19)  to  eliminate  P,  we  obtain 

P,(^0-/lo/^/  ‘Afo)  +  (Ao-A0fA,  ‘^;o)'P| 

+  (K„ -Kr-  A',o A}-  'K,  )DS}D(K. -K,-  A‘I0A'f  'K, )'  -0 


where 


Aq^Aq  —  StKr  —  S2DK'r  Af<> 


AfQ  —  S\K,  —  S3DKr 

(B21) 


VMo  —  —  S2DKP)  +  M,  -  syc,  -  s2DK,y  V,  +  V2D(A/0 

-  s2k,  -  s}dk,) +<a,0-  s2k,  -  s,dk;ydv  2 

+  (K,  -K,)S,(K,  -K,)  +  iKx  -K,)SjD(K, -K,)’ 

+  (K2-K,)DS2(Kt  -K,)  +  (K2 -K,)DS1D{K1  -K,Y  >0 

(B14) 

K  *or  +  KDAf  +M-4o  -  S,K,  -  S2DK,)V2 

+  (A,0-S2K,-S2DKpYDVi+rtKl-K,)SlK2+{Kl-K,)S2DKi 

+  p(Ka  —Kp)DS2K2a-(K2  -Kp)DS,DK,=0  (B15) 

nV^Atjf  +  ixA'0f  V2  +•  VyOAf  4*  Af  DV3  +  n1K2StK2 

+  fiK'2S2DKs  +hK3DS'2K2  +KjDS1DK,  -0.  (B16) 


From  (B8)  we  have 

K^Si  -  [K«  +  {K,S2  -  A'roiAf *  lKf]DS3(Ar  -  S,DK , ' 1 .4} 

K^SiA'f'  *\Km-HKfS2-A'/0)A‘f~iKflDSi{Af-SiDKr)'~'. 

(B22) 

Thus 

Kp  *Km  +  {A,o  —  S'2K,)’ Af  'Kf  A-KfDSyA’f  'Kf 

0  •Km-Kp-A,f0A'r-lKr.  (B23) 

F  urt  hermore,  A0-  A0fA/ 1  Af0  =  A,~  B.R.~  'iE'rC,  +  B'JC, ), 

which  is  stable.  Thus  the  solution  of  (B20)  is  P,  »0. 
Substracting  (B20)  from  (BI4)  and  using  Theorem  3  we 
obtain  that  V ,  «  P,  +0(||«||).  Hence 

F,  «0(||e||),  teH  (B24) 


Let  Pt,  Pj,  and  P,  satisfy  the  equations 


implying  (58). 
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AarntACr  This  paper  discusses  linear-quadratic  infinite-time  nonzero-sum  cloud-loop 
Sash  games  for  systems  with  fast  and  slow  modes,  ft  is  shown  via  example  chat  the  usual 
order  reduction  processes  utilizing  control  ideas  of  singular  perturbation  analysis  leads  to 
an  ill- posed  reduced  order  problem.  A  modification  of  the  performance  indices  is  presented 
which  leads  to  a  well-posed  problem,  when  the  usual  order  reduction  method  is  used. 
Finally,  a  hierarchical  reduction  procedure  is  proposed  which  leads  to  well -posed  fast  and 
stow  game  problems  even  when  the  performance  indices  are  not  modified. 

L  Introduction 

In  a  general  multi-input  system  there  may  be  many  decision  makers  or 
players  each  trying  to  minimize  his  owa  performance  index.  The  system  is 
described  by  a  vector  differential  equation  and  the  performance  indices  are 
functions  of  control  input  vectors  and  state  vectors  over  some  period  of  time. 
We  consider  the  case  where  the  system  equation  is  linear  and  the  performance 
indices  are  quadratic  functions  of  state  and  control  vectors.  A  particular 
strategy,  or  rationale  for  choosing  controls,  is  the  Nash  strategy  which  is 
appropriate  when  cooperation  among  the  players  cannot  be  guaranteed.  It  has 
the  advantage  that  if  one  player  deviates  unilaterally  from  the  Nash  strategy  his 
performance  index  will  not  improve.  When  the  sum  of  the  performance  indices 
is  zero  the  game  is  called  zero-sum,  otherwise  the  game  is  called  nonzero-sum. 
An  ea*ly  paper  on  Nash  strategy  is  given  by  (1)  and  necessary  conditions  for 
open-  and  closed-loop  Nash  strategies  have  been  presented  in  12)  and  (3) 
respectively. 

When  the  system  has  slow  and  fast  modes,  the  control  problem  is  ill- 
conditioned.  that  is  it  is  numerically  “stiff”.  To  alleviate  this  ill-conditioning 
and  to  reduce  the  amount  of  computation,  singular  perturbation  techniques 
have  been  developed,  some  of  which  are  presented  in  (4. 3). 

In  this  paper  we  investigate  the  weil-posedness  of  closed-loop  Nash 
strategies  with  respect  to  singular  perturbation.  There  are  two  principal  reasons 
for  singular  perturbation.  Fust  the  model  can  only  be  an  approximation  of  the 
actual  system  and  we  must  insure  that  the  control  is  robust  with  respect  to 
neglected  fast  dynamics.  A  second  major  reason  is  computational  simplification 

t  This  work  was  supported  in  part  by  the  Division  of  Electnc  Energy  Systems.  U.S. 
Department  of  Energy  under  Contract  EX-76-C-01-20S8,  in  pan  by  the  National 
Science  Foundation  under  Grant  ENG  74-20091.  and  in  pan  by  the  Joint  Services 
Electronics  Program  under  Contract  DaaG-29-'S-C-0016. 
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when  an  original  hill  order  game  is  approximately  decomposed  into  fast  and 
slow  subgames. 

We  give  an  example  of  a  nonzero-sum  Nash  game  whereby  the  natural 
singular  perturbation  leads  to  a  strategy  which  results  in  limiting  values  of 
performance  indices  different  from  the  limiting  values  of  those  corresponding 
to  the  full  order  Nash  strategy.  In  contrast  we  have  shown  elsewhere  (6)  that 
the  corresponding  performance  indices  have  the  same  limiting  values  when  the 
game  is  zero-sum. 

We  then  show  that  a  physically  justified  modification  of  the  performance 
indices  consistent  with  inadequate  modeling  of  fast  dynamics  results  in  a 
well-posed  singularly  perturbed  nonzero-sum  Nash  game  problem  when  the 
natural  perturbation  method  is  applied.  With  this  modification,  computational 
savings  can  be  gained  and  a  close  approximation  to  the  optimal  performance 
indices  obtained  by  order  reduction  of  the  Riccati  equations. 

Finally,  we  present  a  hierarchical  reduction  procedure  which  leads  to  a 
well-posed  singularly  perturbed  modified  slow  game.  This  reduced  order  slow 
game  differs  from  the  natural  one  in  that  it  contains  information  about  the  low 
order  fast  game.  The  problem  is  well-posed  with  respect  to  the  original 
performance  index  for  the  full  order  game.  Computational  savings  and  a  ciose 
approximation  of  the  performance  indices  are  achieved. 

EL  IU-Posedness  of  lVonzee-jum  Sash  Games  with  Respect  to  Singular 
Perturbation 

Consider  a  singularly  perturbed  time-invariant  system 

i,  «Auxl+-A12*i-t-fltlul  +  Bl2uz;  x,(to)»xvt)  (la) 

HJ&2  *  AjiX1  +  A-2Xi  +  fl21ul “  XTSS  (lb) 

and  performance  criteria 


Q2][x'  +u'i?«'4'  +  u^ufj  df; 


W“  1.2.  i*j 


(2) 


where  u  is  a  small  positive  scalar.  xt  and  x2  are  nx  and  n2  dimensional 
components  of  the  state  vector,  u,  and  u,  are  mj  and  m-  dimensional  control 
vectors  to  be  chosen  by  Players  1  and  2  respectively  in  accordance  with  the 
Nash  solution  concept,  and  the  control  strategies  are  restricted  to  be  linear 
feedback  functions  of  the  state.  Denote 


£]• 


Ai2 

A^/nJ’ 


S, 


Q 


Qn 

Q,  3 


* 


The  usual  definiteness  assumptions  are  made  on  Qf  and  R,,,  L  /  *  1,  2. 

The  optimal  closed-loop  Nash  strategy  for  Player  i  for  (2)  subject  to  (1)  is 
well  known  (3)  and  given  by 

u, --fCB'Kx  (3) 
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where  K,  is  a  stabilizing  solution  of  the  coupled  Riccad  equations  given  by 
0  -  -tQ,  +  £A  +  A'K)  +  KtB&Ti'B’tKt  +  KJtfRJi'BjK,  +  KfB^^BjK, 

for  «,/—  1. 2;  if*/.  (4) 

Notice  that  since  A  and  B,  are  functions  of  the  small  parameter  is  a-  o  a 
function  of  jx.  In  general  even  for  low  order  problems  the  presence  of  jx  causes 
numerical  “stiffness”  in  (4).  For  this  reason  and  for  computational  reduction 
the  problem  (1),  (2)  in  the  one  Player.  Le.  control,  case  is  generally  approxi¬ 
mated  by  a  lower  order  problem  by  formally  setting  jx  ■  0.  This  produces  a 
control  which  when  applied  to  the  full  order  plant  gives  a  close  approximation 
to  the  optimal  cost.  In  this  section  we  examine  the  standard  reduction  method. 

The  standard  approach  to  obtaining  a  reduced  order  model  is  to  set  *x  *  0  in 
(lb),  solve  for  xj,  assuming  A-j  is  non-singular,  and  substitute  in  (la)  to  obtain 

iv  *  (Au  —  At^Ajj  Aji)xt  +(B11  — AnAjjBijlUt 

+(Bt2-Al2AilB-*)u,,  x1(t0)*xl0  (5) 

where  the  bar  indicates  that  jx  «0.  Rewriting  (5)  we  get  the  “slow”  (since 
setting  ji,»0  is  equivalent  to  saying  that  the  fast  states  are  infinitely  fast) 
subsystem 

x,  ■  AqX,  +  Boi  uu  + Botu x,(ro)»x10  (6) 

where 

Ao  *  Alx  —  A|jAa  A2j, 

Boi  “Bli-Ai2Ai2lB21,  i  *  1,  2. 

The  corresponding  “slow”  performance  criteria  found  by  substituting  x?  when 
u  *  0  into  (2)  is 

l*m\  \  UjOnA  •*-2x;0i2(S2iH(,  +  Bv%)* u&u*  u'&u,, 

-  -to 

+  2u{,0i3Uf,}  dr  i,;»  1,2,  is*/  (7) 

where 

Qi\  *  Q,  I  -  Q|2A{2  A„  -  ( A22l  A2l)' Qi2  *  ( AJj1  A^/Q^Ak1  a21, 

0i2  *  t  A221A2l)'QijAJ2  -  Qi2A-j2l, 

A*  m  Ra  +Bj((Aj2)  QijA^B-j, 

Au  *  R^  -t*B2l(,A22l)  QijAjj1  B-(, 

O13  *  B2|(A22)'QijA  23  By- 

Solving  for  the  reduced  order  closed-loop  Nash  strategies,  we  have 
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where  K*  is  a  stabilizing  solution  of 

0  *  -{On  ■*"  AofC,  ■*"  Ki*Ao)  +  —  M OnS^tlWi* 

+  M'^B'ofK,  +  Bfv O'J,  for  i,  / »  1,2,  i  *  /'.  (9) 
Using  the  gain  matrix  M,  from  (8b),  we  implement  the  control 

u< »  (10) 

and  apply  it  to  the  system  in  (1).  The  resulting  value  of  the  subop timai 
performance  criteria  in  (2)  can  be  expressed  as 

/u-  ix'dbiv^xtto)  (11) 

where  satisfies  the  Lyapunov  equation 

V*JA  -  S.C-H,  i  03  -  B,m,  ;0]}+{A-  B,[A4  i  0]-  B,m,  \  0]}' 

+ r 9ii i . 9.n ]  ,0  (12) 

L  Q' 2  '  Qa-1 

The  matrix  depends  on  u  since  A  and  B,  contain  #1-  Hence  the  reduced 
cost  is  dependent  on  m>. 

If  the  optimal  Nash  controls  given  by  (3)  are  applied  to  ( 1),  the  values  of  the 
optimal  performance  criteria  are  given  by 

/«-**'(* o)Kx(to)  (13) 

where  K,  satisfies  (4).  We  wish  to  examine  the  nature  of  the  optimal  criteria  Ji 
as  It  particular  we  wish  to  verify  if  J,  approaches  J^  as  1*  approaches 

zero.  We  will  say  chat  the  reduced  order  game  is  well-posed  if  /,  approaches 
J^  as  im~* 0.  Otherwise,  we  say  that  it  is  ill-posed.  We  perform  this  compari¬ 
son  on  a  specific  numerical  example. 


Consider  the  second  order  system 

EH-i. 

uMJJ“> 

(14) 

Kl-Q] 

with  performance  criteria 

Mi 

(15a) 

'MI  Mi 

(15b) 

For  this  example,  the  resulting  fQ,  and  .Vf,  from  (9)  and  (8)  are 

K»mK*myIjZm  o-6804 

(16) 
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and 


M11-  M*  -0.4082.  (17) 

Calculation  of  the  resulting  values  of  J\  for  several  values  of  n  are  given  in 
Table  I.  Because  of  symmetry,  /, »  J2  »  /. 

Tajlb  I 


0.5 

0.2 

0.1 

0.01 

0.005 

0.001 

0 

J 

1.3012 

0.73245 

0.5425 

0.3724 

0.3630 

0.3630 

0.3536 

1.84127 

0.86558 

0.59083 

0.36420 

0.35217 

0.34259 

0.3402 

It  is  seen  that  the  limit  of  /,  as  ix-*0  is  different  from  the  corresponding  limit 
of  This  discrepancy  between  the  J’s  in  the  neighborhood  of  n  *  0  indicates 
that  the  reduced  order  Nash  strategy  obtained  by  the  standard  method  is 
ill-posed. 

£0L  Regularization  of  the  Cost  Functional  Consistent  with  Inadequate  Model¬ 
ing  of  Fast  Dynamics 

The  manner  in  which  the  singular  perturbation  approach  could  be  modified 
so  that  we  have  a  well-posed  problem  depends  on  the  reason  for  the  appear¬ 
ance  of  the  singular  perturbation  parameter  in  the  system  model.  In  this  section 
we  discuss  the  first  of  two  reasons  considered  in  this  paper.  Let  us  suppose  that 
we  have  a  Nash  strategy  using  a  model  represented  by  (la)  and 

0  "  AjiJtj  +  A'aJtj  +  BnUi  •r  ( IS) 

We  wish  to  examine  the  robustness  of  the  Nash  strategies  when  the  actual 
system  is  represented  by  (lb)  instead  of  (18).  The  performance  index  in  (.2) 
leads  to  an  ill-posed  problem  as  we  demonstrated. 

If  indeed  the  original  model  used  for  design  is  based  on  (la)  and  (18).  then 
for  consistency  it  is  appropriate  to  assume  that  the  vector  x-  that  appears  in  (2) 
is  constrained  by  (18).  That  is,  from  (18)  we  have 

Xj  +  (19) 

Substituting  (19)  into  (la)  we  obtain  (5)  and  substituting  (19)  into  (2)  we  obtain 

■A  *2  + 

+  u(J^,u,+2u(Oi3U(}dr.  (20) 

The  modified  performance  index  in  (20)  for  L,  j »  1, 2,  i *  j,  reflects  the  model 
constraint  of  (18).  In  this  case,  the  variable  x-  in  (2)  is  not  a  component  vector 
of  the  state  x.  but  it  is  simply  a  function  of  xlt  u,  and  u,  as  given  in  ( 19).  For 
example,  in  a  d.c.  motor  model,  we  may  be  interested  in  penalizing  the 
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armature  current  However  if  our  model  neglects  armature  inductance  then  the 
armature  current  is  expressed  as  a  function  of  the  speed  and  the  voltage.  On 
the  other  hand,  in  our  earlier  ill-posed  example,  x,  in  (2)  is  not  constrained  to 
satisfy  (19)  but  instead,  it  is  pan  of  the  state  as  given  in  (lb).  Thus  in  this 
reformulated  problem,  we  are  interested  in  comparing  the  Nash  strategy  that  is 
obtained  from  (la),  (18)  and  (20),  which  is  the  same  as  (6)  and  (7),  with  the 
Nash  strategy  that  is  obtained  from  (la),  (lb)  and  (20)  as  n-*0.  We  show  that 
this  is  a  well-posed  problem  with  respect  to  singular  perturbation  so  that  the 
Nash  strategy  is  robust  against  inaccuracies  caused  by  neglecting  fast  dynamics, 
provided  that  these  are  stable  (Le.  Aa  is  stable). 

For  the  full  order  problem  (1)  and  (20),  the  optimal  closed-loop  Nash 
solution  is  given  by 

u,  -  ‘{BiiC 0'2 ;  0]x  :  BWn]£x  +  (21a) 

- (21b) 
where  £  is  a  stabilizing  solution  of 

J]+£A  +  A'£-£B^-tf?Bf£ 

-  [^‘j]bvH  ;  0]+M'F>f,  -  MflVH.  ■  (22) 

The  optimal  cost  for  (20)  subject  to  (1)  is  given  by 

/u»i*'(*o)K.*(to).  (23) 

If  the  control 

iV  -  (24.) 

where  is  from  (8)  is  applied  to  (1)  for  performance  indices  (201  a 
subop timal  performance  cost  results  which  can  be  written  as 

(25) 

where  P„  is  the  positive  semidefinite  solution  of  the  Lyapunov  equation 

PA  A  -  B,[,H. ;  0]-  fl,[A4  :  0]}+{a  -  B,[1H, :  ;  Ofl'p,  +  [J  J]  -  0 

(26) 

and 

6  *  Oi  i  ~  OirCBjjjVl),  +  B2lMf,  J  -  +  B- Otz  4 

+  +■ 

We  shall  compare  the  optimal  Nash  performance  cost  (23)  to  the  suboptimal 
performance  cost  (25).  In  order  to  perform  this  comparison  we  need  some 
relationship  between  the  optimal  Riccati  gain  K,  and  Ptr.  A  relationship  is 
found  by  first  giving  conditions  under  which  K,  possesses  a  power  series 
expansion  at  ix  m  0  and  then  giving  conditions  under  which  P(,  possesses  a  power 
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series  expansion.  Finally,  we  form  a  new  Lyapunov  equation  by  substracting 
(26)  from  (22)  and  show  that  there  is  in  fact  a  relationship  between  the  optimal 
performance  cost  and  the  subopdmal  performance  cost. 

Represent  R,,  the  solution  of  (22),  as 


£(*)»!' *ilU) 

^  Ihkm  m*) r 


'1,2. 


(27) 


0  -  On  +  A„  +  A'lliS>+ Xix + A^ft® 

+■ 

-  SftCAi  -  OlsAl^J-^Bi^S? + BsAf  +  Bi.O',] 

~  Qu&u 1 

-SfxC^-OuA.'O.  J  lR«[A(  “  Ou&ii  L$n 

+  #?B„  +  0(2B„] 

x  ca,  -  o)3^jiotJriCB^?  -  0(j^«‘b^?] 

-  s'l^  -  o,3A-io,3r ‘b^? + sfiCRj,  -  o/3R-ioi3r 1 

x  AfiAf  ~  OijRh  1<3i3]_1[B2/1^3i~  OoRn  lBAi^,T] 

— — 0i3-Rji  lO(3]~lAiCAi  ~  Oij^K  l$f3] 1 

x[b^'-<5(3^‘b^?] 

0  *  Ko'A-jj  +  Ai2^J3’  —  ^l3'B2j[i^,  —  Of  j-Ru 1 0i3]~ 1 

x  (B^?  -  0,3R«lB^o3*)  -  (Xfs  B„  -  tigBvAz'Gtf 

x  [A,  -  0i3r«  1 0>3r 1  B4,&!’ + ( Aj?  b„  -  ^S’B^rOjj) 

x  [A(  —  OfjA(j  l0j3]  1  AffAi  “  OjjAif  l0j3]  1 
x  {B'v&$ -  4,&lBi£%)-(g8B*  -  !C$BVR-'  0(3) 

xCAf-OfsA^O^r^CA-O^^O,,]-1  ■  (B^-OaR^B^T) 

where 


(28) 


(29) 


(30) 


S,  t  *  BiOfa  +  B\XT  -  B'2iKf?  -  0i3A-‘[BJ(0'2  +  B'UK‘T  +  (31) 


and 


K<i2'-Klk(fx)L.o,  i-1,2,  k-1,2,3.  /-1. 2,  £»*/. 


(32) 


In  the  comparison  of  the  optimal  performance  and  the  suboptimai  perfor¬ 
mance  costs  we  need  the  following  condition: 

Condition  a 


is  non-singular  where 


r*i  ail 
La,  3i J 

si,  ~r®A;^A;®r 

a,  =»r® 


(33) 
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and 

Aj  ■  A0—  SojAf j,  +  l[S4|0?2'*'  Soj K&  —  RyA *((,]“  Bot-Ru 1  R^M. j, 

B,  - B0^«l[B4,Of2  +  B&^  - &iiMit]+BoiA-ld'ii&7il&tW, 

where 

^  “ Oiji^u  l0(j,  i»  /  “  1.2,  i^j. 

®  is  the  Kronecker  product  operator. 


Theorem  I 


If 

(1)  A 22  from  (1)  is  stable; 

(2)  The  slow  game  (61,  (71  has  a  unique  stabilizing  closed-loop  Nash  strategy 
pair; 

(3)  ^3**0  is  the  unique  positive  semidefinite  solution  of  (30); 
and 

(4)  Condition  a  is  satisfied; 

then  the  solution  Ki  ■£(/*)  of  (22)  possesses  a  power  series  expansion  at 
n  ■  0,  that  is. 


where 


*W" 


dn1 


14  “0 


i-1,2;  k-1.2,3. 


Furthermore,  the  matrices  Kff,  and  ft$  satisfy  the  identities 


%?-K. 
R$—K*Ax2  a 
Kll'-O. 


(34) 


<35) 


(36a) 

(36b) 

(36c) 


Proof:  The  proof  is  given  in  Appendix  A. 

A  relationship  between  the  suboptimai  control  (24)  and  the  optimal  control 
(21)  is  found  by  substituting  (34)  into  (21)  and  letting  n  ■  0.  Comparison  of  the 
resulting  equation  and  (24)  using  the  identities  (36)  yields 


u*»u,+  0(n),  i»  1,2.  (37) 

The  result  in  (37)  is  analogous  to  the  “composite”  control  formulation  in  (5). 
Even  though  there  is  no  x,  present  in  (24),  the  result  in  (37)  is  not  unexpected 
since  the  fast  part  of  K,  for  u  -  0  is  zero.  Thus  we  really  have  a  “composite'* 
control  but  the  fast  pan  of  that  composite  control  is  zero. 

Since  the  reduced  control  (24)  is  close  to  the  optimal  control  (21)  we  expect 
that  the  reduced  cost  (25)  is  close  to  the  optimal  cost  (23).  We  state  the 
following  results. 


I  1 


'  i 
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Theorem  U 

If  An  is  stable  and  if  there  exists  a  unique  stabilizing  closed-loop  Nash 
solution  to  the  slow  game  (6),  (7),  then  P„  i « 1, 2,  in  (25),  (26)  possesses  a 
power  series  expansion  at  ix  m  0.  that  is. 


where 


PJp)' 


v  *ir  w 

uPV 


j-0  ]•  Li 


laPgfJ 


(38) 


pti)  — 

^  du1  * -o' 


t-1,2,  fc-1,2,3. 


Proof:  See  Appendix  B. 

Applying  the  reduced  control  (24)  to  the  system  (1)  and  comparing  the 
resulting  cost  to  the  optimal  cost  gives  the  following  theorem. 


Theorem  H7 

The  first  terms  of  the  power  series  expansion  at  m.  *  0  of  in  (23)  and  V„ 
in  (25)  are  the  same,  that  is, 

K-J^-MXm),  i-1,2.  (39) 

Thus  the  reduced  order  slow  game  in  (6)  and  (7)  is  well-posed  with  respect  to 
the  full  order  game  in  (1)  and  (20). 

Proof:  See  Appendix  C. 

It  should  be  noted  that  in  (20)  Xj  does  not  appear  explicitly  and  that  there 
are  cross  terms  of  x(  with  u,  and  ut  and  also  cross  terms  of  u,  and  u,.  Using  a 
linear  transformation  among  xu  u,  and  u,,  a  performance  criterion  without 
cross  terms  could  be  obtained.  However,  in  this  case,  the  transformation  would 
induce  an  additional  structural  constraint  on  the  control,  and  the  Nash  solution 
might  be  different.  Thus,  no  such  transformadon  is  used  in  this  section.  A 
second  point  to  note  is  that  although  Xj  does  not  appear  in  (20),  the  ’‘slow” 
part  of  x,  as  given  by  (19)  does  appear,  since  (19)  was  substituted  into  (2)  to 
obtain  (20). 


/V.  Hierarchical  Reduction  Scheme  which  Transfers  Fast  Game  Information  to 
a  Modified  Slow  Game 

In  Section  HI  we  demonstrated  that  if  the  system  model  for  control  design 
contains  only  slow  modes  and  we  wish  to  determine  the  robustness  of  the 
nonzero-sum  Nash  strategy  to  the  presence  of  fast  modes  in  the  actual  system, 
then  the  performance  indices  should  not  include  the  fast  modes  of  the  system. 
That  is.  if  we  have  a  system  with  fast  and  siow  modes,  then  in  order  to  have  a 
well-posed  reduced  problem  under  the  usual  singular  perturbation  reduction 
method,  the  fast  modes  of  the  system  should  not  be  penalized  in  the  perfor¬ 
mance  indices.  On  the  other  hand,  if  the  system  is  assumed  to  be  adequately 
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modeled  and  the  fast  modes  appear  in  both  the  state  equations  and  perfor¬ 
mance  indices,  and  it  is  desired  to  reduce  the  amount  of  computation  and 
alleviate  the  numerical  stiffness  of  the  closed-loop  Nash  control  problem,  we 
have  seen  via  the  example  in  Section  II  that  the  usual  order  reduction  method 
of  singularly  perturbed  optimal  control  problems  does  not  lead  to  a  well-posed 
Nash  game. 

In  the  method  of  Section  II  it  is  implicitly  assumed  that  the  fast  modes  and 
slow  modes  can  be  completely  decoupled.  However,  we  have  shown  that  if  we 
directly  penalize  the  fast  modes,  the  fast  and  slow  modes  cannot  be  completely 
decoupled.  Taking  this  into  account  we  propose  to  first  solve  a  fast  low  order 
game  and  then  implement  the  fast  feedback  control  in  the  system  and  perfor¬ 
mance  indices  before  obtaining  a  reduced  order  slow  game.  Thus  we  are 
proposing  a  block  triangular  or  hierarchical  rather  than  the  usual  block 
diagonal  decomposition. 

To  derive  the  fast  subsystem,  we  assume  that  the  slow  variables  are  constant 
during  fast  transients.  Denoting  the  fast  variables  by  the  subscript  f  we  have 
the  fast  subsystem  and  performance  indices 

IJLXf  *  A-aXf  +  Xf(tb)  -  XM-x2(tb)  140) 

Jv  C*fQiJJtrhuv^14tf  +  u^j%]dt;  i,  /  *  1, 2;  i*j,  (41) 

where  x1 »  x^-x^.  The  closed-loop  Nash  controls  for  (41)  subject  to  (40)  are 
u,f  *-R~ilB!llKt0f,  i*1.2  (42) 

where  K,f  is  a  stabilizing  solution  of 

0  *  —Ql3  —  KtfA-22  ~  A'lzKtf  4*  KtfBiiR JCf +  1 

+  KtfB2iRfi lB?iKtf  —  KfBztR„ 1  'B^K^,  i,jm  1,2,  i*j.  (43) 

Next  we  make  use  of  the  fast  control  and  substitute  the  following  for  u,  in 
our  original  system  (1)  and  performance  indices  (2).  Let 

u,  ^-R7iXB’2iKtfX2JrUi  (44) 

be  our  modified  control.  This  gives  a  new  system  and  performance  indices 
given  by 

+  *i('o)**io  (45a) 

*  A,!*!  +  A22x2  -t-  Btlul  *  x2(to)*x20  (45b) 

and 

■^*7 1  j*  q,^ 

+  u'iR<A  +ufi?l,i3f|  dr  1, /*  1.2.  1 *  /,  (46) 
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where 

At2  =  An  — BuPii  B^i Kif  ~ B12R22  Bm-^v 
A 22  m  A22  —  BjiBu  B^iKif  ~  B22P22  ^22^2f 
0(3  *  0(3  +  KfBziRu  lB2tJCtf  ^IfBzfR^ 1 *.,*« 1 

To  get  our  “modified  slow”  subsystem  we  formally  set  (i.  *  0  in  (45b)  and 
solve  for  x2-  This  gives 

i-2 m  “A ntA^ii  +  B2\U\  +•  (47) 

Substitution  of  (47)  into  (45a)  and  (46)  gives  us  the  “modified  slow”  subsystem 
and  performance  indices 

™  AqJC^,  +  S01  ,  ^^(toj^Xio  (48) 

and 

4m  »r  [x,«1OuX™+2x5mO(2«ta»  +2jC'1m0(2*Wt-2u(Mtt0i3Sm 

dr,  i,  /  *  1, 2.  i>/,  (49) 

where 

Ao  m  Au  -  At2A.22l A21 
Bru  m  Bu  “  Al2A 221Bh 

0(l  -  Ql  -Qa^«lA«  -(A22lAI1)'Q'2>(A22,A21)  OiJ-^22^21 

O12  *  “0(2*4 22  B21  + 1 A221  A2i)  O0A22  B21  +•  ( A22  A21)  K, fB-ii 
0(2  * -aaAsffl*  “ ( A22 A2i)* O0A22 B21  +! A.22 Ajt)  K,fB-2iR,i iR,i 
Oo  *  B^Aj-1)' 0(3^22' B2j  +  B’nKtfA.22  Bn  ~  BziiAiz)  Kit&aRu  l^ii 

■*"  Bi,(A2-2l)'0uAilB2(  •*■  B^iiAZj)' KjfBijRu  ~  ^fRii 1  Bii-K^A^j B-f. 

We  will  show  in  this  section  that  the  reduction  process  we  have  described 
leads  to  a  well-posed  reduced  game.  Note  that  the  modified  slow  subsystem 
and  performance  indices  are  of  the  same  form  as  in  the  slow  problem 
considered  in  Section  II.  However,  the  system  matrices  and  performance 
coefficients  contain  informadon  about  the  fast  low  order  game.  Examining 
(44)  we  see  that  we  still  have  a  control  composed  of  fast  and  slow  parts. 
However,  since  we  substitute  the  explicit  form  for  the  fast  pan  into  the  state 
equation  and  performance  indices  before  the  slow  state  equation  and  perfor¬ 
mance  indices  are  formed,  the  slow  modes  are  dependent  on  the  fast  modes.  In 
Sections  II  and  EH  the  fast  modes  and  slow  modes  were  completely  separated. 
The  closed-loop  Nash  strategy  for  (49)  subject  to  (48)  is  given  by 

4-  B^K^X^  J-  <5ij«f,m  j 

«-iVf*x,m 


vot  jo*.  No.  s.  .In— m  irr« 


(50) 

*51) 


B.  F.  Gardner.  Jr.  and  J.  B.  Cruz ,  Jr. 

where  KUm,  K-^  satisfy  the  coupled  Riccati  equations 

0  *  — Ou  —  KismA-o  ~  Ao  Kitm  +  +  OiijMij  —  +•  QfJ 

+  i,/- 1,2;  i#/.  (52) 

Of  course  (51)  and  (42)  are  only  subsystem  optimal.  That  is,  as  they  stand  we 
cannot  apply  them  to  the  original  system  (1).  Following  the  methodology  of  (5) 
we  form  a  “composite"  control  involving  both  fast  and  slow  control  coeffi¬ 
cients.  The  form  for  the  composite  control  is  suggested  by  (44).  Forming 


—M^Xi  —Ra'BiiKtfXi 

(53a) 

(53b) 

-RZ'B'HcX 

(53c) 

where 

Km  =*  {-Oa  -  MlKf  -  Ou  +  (KtonBo,  +  (5,2  ■ HKmAi  +  0.  <5f,) 

•  CH»  -  Q'lR-'Qh^lB^K*  -  (54) 

We  note  that  the  coefficient  of  xt  involves  both  fast  and  slow  Riccati  gains 
while  the  coefficient  of  x,  involves  only  fast  Riccati  gains. 

If  the  composite  control  (53)  is  applied  to  (1)  for  performance  indices  (2)  a 
subop timal  performance  cost  results  which  can  be  written  as 

(55) 

where 

0  -  P*[A -BlR-lB;\^-BlR-'B'iM*]HA-BiR-lB[Hc-BiR-lB’MPx 
+  Q  +M'eB,RTlB'M(e  +  M'cBlR~jlRiiR~jlB’jMic.  (56) 

To  compare  the  optima,  performance  cost  (13)  and  the  composite  performance 
cost  (55)  we  need  the  following  conditions: 

Conditions  b 


(57) 

is  non-singular  where 

jSl}  *  A^2  "*■  Aij®  / 

and 


Condition  c 


C,  -  B,,R  J 1  B^K*  -  S,(R- 1  R,jR" 1 Bi,**. 


iJ,  ifj 


(58) 
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is  non-singular  where 


sdi  Af  +  A,'®/ 


A  *  A0  SofAib  ■“  BojAtfa  +  N1  lrf 

rt  *  +  B-jjK'm  ~  -RfMf,  “  BfB 

x  C*“  A^  +  32iyt,  *+■  B^fiVfJ,  J 

Ntl  -  $oilR« -  B7lJV?JlB^]A«lTTl 

Nij  *  {“  A12A22  +  Bij[B,(  lB2lKtf  —  Bn  lB2jJsf]A22  Bn 

T(  -  r-B^CBj'Bi.ig-BJ^BJ^^lA^B,, 
x  [Bu  lBiiB^  —  Bu  'Bii-KifjAJj . 


II  these  conditions  hold  we  have  the  following  theorem. 

Theorem  IV 
II 

(1)  the  fast  game  (40),  (41)  has  a  unique  stabilizing  closed-loop  Nash 
solution; 

(2)  the  modified  slow  game  (48),  (49)  has  a  unique  stabilizing  closed-loop 
Nash  solution; 

(3)  Condition  b  is  satisfied; 
and 

(4)  Condition  c  is  satisfied: 

then  K,,  the  solution  of  (4),  possesses  a  power  series  expansion  at  u  »  0,  that  is. 


where 


K.M 


fa! r*iv  *Kiv 
-0  /!  weir  ijbs. 


K% 


.VKM 


du’ 


u«*0 


1,2;  fe -1,2,3. 


(59) 


(60) 


Furthermore,  the  matrices  K[ and  KJ®’  satisfy  the  identities 
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Proof:  The  proof  is  similar  to  the  proof  of  Theorem  I  and  is  omitted  for 
brevity. 

An  immediate  result  of  Theorem  IV  is  that 

(61) 

where  u<  is  the  optimal  Nash  control  for  (1),  (2).  This  can  be  shown  easily  by 
substituting  (59)  into  (3)  and  letting  /a  *  0.  The  identities  found  in  Theorem  IV 
yield  (61).  Furthermore  we  have  the  following  results. 


Theorem  V 

If  the  fast  game  (40),  (41)  has  a  unique  stabilizing  closed-loop  Nash  solution 
and  the  modified  slow  game  (48),  (49)  has  a  unique  stabilizing  closed-loop 
Nash  solution,  then  P*  possesses  a  power  series  expansion  at  u  *  0,  that  is. 


f  n\ 

‘•"A/sUpss 


(62) 


Proof:  The  proof  is  similar  to  the  proof  of  Theorem  II  and  is  omitted  for 
brevity. 

As  a  result  of  K,  and  Px  possessing  power  series  expansions  at  n  =  0  it  is 
easy  to  show  that  their  difference  also  has  a  power  series  expansion  at  p.  »0. 
Comparison  of  the  optimal  Nash  performance  with  the  composite  performance 
costs  gives  the  following  theorem. 


Theorem  VI 

The  first  terms  of  the  power  series  expansion  at  ja  =  0  of  K  and  P*  are  the 
same,  that  is, 

4»/(t0(m).  (63) 

Proof:  The  proof  is  similar  to  the  proof  of  Theorem  HI  and  is  omitted  for 
brevity.* 

Thus  far  we  have  not  changed  the  structure  of  the  controller  for  the  full 
order  system  (1).  That  is,  the  composite  controls  are  a  function  of  both  x,  and 
x2  as  are  the  optimal  Nash  closed-loop  controls.  If  it  is  desired  to  implement 
the  control  as  a  function  of  x,  only  to  achieve  an  O(^)  approximation  of  the 
optimal  cost  we  use  the  following  procedure.  Substitute  the  composite  control 
(53)  into  (lb)  and  let  >a  »0.  This  gives  as  an  approximation  of  x2 

Xj  *  ]X[.  (64) 

If  (64)  is  substituted  for  x2  in  the  composite  control  we  have  a  "lower  order” 

*  Thus  the  modified  slow  game  is  well-posed  with  respect  to  the  modified  reduction 
procedure.  Furthermore,  it  can  be  shown  that  u*  satisfies  an  Asymptotic  Nash  property 
in  the  sense  that  u^)-r<Xn),  i .  /  *  1,  2;  i*  j.  The  reduced  order  control 

satisfies  a  similiar  inequality. 
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control  as  a  function  of  xt  only.  This  lower  order  control  is 

Uu  *  —{Mb  —  Ru 1  BitKifA.-zz[An  —  B^i-Mi,  —  B^M^Uxi  (65a) 

-  -R:lB;MuX  (65b) 

where 


and 

Kim  *  Km  —  C-^-21  ~Bl\Mu  —  (A-yi)'  Ktf. 


If  (65)  is  applied  to  the  full  order  system  (1)  for  performance  indices  (2)  a 
cost  results  which  can  be  written  as 

/(,  *  i*o-Pu*o  (66) 

where  Pu  is  the  positive  semidefinite  solution  of  the  Lyapunov  equation 

0  -  PuCA -BiRZ'B'iMa  -  B.-R-'BfM,  -  B.B-'B'MJP, 

+  Qi  +  M'ilB(R7llB’Ml  +M;,ElR-lRiiR^lB’Mll.  (67) 

Following  the  method  used  earlier  in  this  paper  we  have  the  following  theorem. 


Theorem  VET 


If  Am  is  stable  and  the  modified  slow  game  (48),  (49)  has  a  unique  stabilizing 
closed-loop  Nash  solution,  then  P«  possesses  a  power  series  expansion  at  n  *  0, 
that  is. 


nPf2' 

U  A/lUPft  fd’HiJ' 


(68) 


Proof:  The  proof  is  similar  to  the  proof  of  Theorem  II  and  is  omitted  for 
brevity. 

Since  P,,  and  Pv  possess  power  series  expansions  at  ft  *  0  it  can  be  shown 
that  their  difference  also  has  a  power  series  expansion  at  n  -  0.  Comparison  of 
the  composite  performance  costs  and  the  lower  order  performance  costs  gives 
the  following  theorem. 


Theorem  VTZ7 

The  first  terms  of  the  power  series  expansion  at  ,u  *  0  of  Pu  and  Px  are  the 
same,  that  is 

/«»4+0(m).  (69) 

Proof:  The  proof  is  similar  to  the  proof  of  Theorem  IH  and  is  omitted  for 
brevity. 

As  a  result  of  Theorem  vm.  it  can  be  seen  that  the  costs  at  u  »  0  for  the  full 
order  optimal  Nash  game,  the  full  order  game  with  composite  control  applied. 
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and  the  full  order  game  with  the  lower  order  control  applied  are  the  same. 
Thus  we  have  shown  that  the  modified  slow  game  which  leads  to  the  composite 
control  Ufe  in  (53)  and  to  the  reduced  control  u«  in  (65)  is  a  well-posed  reduced 
order  closed  loop  Nash  game,  without  having  to  modify  the  original  quadratic 
cost  functions  in  (2). 


V.  Conclusions 

We  have  shown  via  example  that  the  usual  order  reduction  procedure  for 
singularly  perturbed  optimal  control  systems  does  not  lead  to  a  well-posed 
problem  when  extended  directly  to  the  linear-quadratic  nonzero-sum  closed- 
loop  Nash  game.  If  the  fast  dynamics  are  not  known  exactly  then  only  the  slow 
part  of  the  fast  states  should  be  incorporated  into  the  performance  indices.  We 
have  shown  that  in  this  case  the  usual  order  reduction  procedure  for  singularly 
perturbed  optimal  control  systems  leads  to  a  well-posed  problem. 

On  the  other  hand,  if  it  is  assumed  that  the  fast  dynamics  are  known  and  are 
incorporated  in  both  the  state  equation  and  performance  indices,  we  have 
shown  that  by  using  a  hierarchical  reduction  procedure  developed  in  Section 
IV  the  resulting  modified  slow  game  is  well-posed.  This  hierarchical  reduction 
procedure  differs  from  the  normal  singular  perturbation  order  reduction  proce¬ 
dure  in  that  it  is  a  block  triangular  or  sequential  process  rather  than  a  parallel 
decomposition.  In  this  sense  it  is  analogous  to  the  reduction  method  of 
Kokotovic  and  Yackel  (7)  for  singularly  perturbed  optimal  control  problems 
where  they  had  the  slow  Riccati  equation  dependent  on  the  fast  Riccati  gain.  In 
our  hierarchical  decomposition  the  fast  subsystem  may  be  found  independently 
of  the  slow  subsystem  but  the  converse  is  not  true.  Also,  a  choice  is  provided 
for  implementing  the  approximate  control  as  either  a  function  of  fast  and  slow 
states  or  as  a  function  of  slow  states  only.  As  in  the  optimal  control  case, 
knowledge  of  the  value  of  the  small  parameter,  jx,  is  not  necessary  to  obtain  an 
0(*x)  feedback  control  design. 

In  contrast,  for  zero-sum  Nash  games  (6),  although  the  performance  indices 
contain  fast  modes,  the  natural  order  reduction  used  in  optimal  control 
formulations  leads  to  well-posed  problems.  That  is,  in  zero-sum  games  it  does 
not  matter  whether  the  order  reduction  is  due  to  ignorance  of  inadequately 
modeled  fast  dynamics  or  due  to  computational  simplification  only. 
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Appendices 

Appendix  A:  Proof  of  Theorem  1 

The  approach  to  the  proof  of  Theorem  I  is  to  represent  A  as  given  by  (27).  When 
this  form  is  substituted  into  (22)  we  will  show  that,  under  the  conditions  of  Theorem  I. 
each  term  in  the  series  expansion  of  A  about  n  *  0  exists  and  is  unique.  Then,  clearly, 
there  is  a  n * > 0  small  enough  to  guarantee  convergence  of  the  series  for  all  0S|i  <u*. 
The  substitution  of  (27)  into  (22)  at  u  *0  yields  Eqns.  (28H31);  i,j ■  1, 2;  i A  /.  If 

#?-0,  (  -  l,  2  (A.1) 

is  the  unique  positive  semide finite  solution  to  (30),  then  (A.1)  may  be  substituted  into 
(29)  to  uniquely  yield 

I?!?3*-  (A.2) 

Substitution  of  (A.2)  and  (A.1)  into  (23)  and  manipulating  gives 

0-0u  +  Ao  +  A^“* *  GnB-u  ]M;  -  +  Si.OfJ 

*  wAM  -  wAm  (a3) 


where 

M. -iA- 013^,7l0,JriCfl'..0rl + B'o£ ;?  *  -  B'o,^)} 

i,im  1.2;  i*j.  (A.4) 

Comparison  of  (A.3)  and  (9)  show  that  the  two  equations  are  identical  with  A, 
appearing  in  (9)  where  Aa'  appears  in  (A.3).  Thus,  if  A,,  i  -  1. 2.  is  the  unique 
stabilizing  solution  to  (9) 

i-1,2.  (A.5) 

Substitution  of  (A.5)  into  (A.2)  gives 

^--K^AuAi1,  1-1,2.  (A.6) 

Thus,  we  have  shown  that  the  first  term  of  the  series  exists  and  is  unique. 

To  see  if  the  second  term  of  the  series  exists  we  substitute  (27)  into  (22)  and  take  the 
first  partial  with  respect  to  u  at  u  -  0.  This  gives,  with  some  manipulation. 

0  —  ^j’Au  i*  AjjKij’ — [(AuAijyKi^Ati -*•  A'nl^'i’AiiAjj],  i  —  1.2.  (A.  7) 

[f  Ab  is  stable  (A.  7)  possesses  a  unique  solution.  If  we  now  assume  that  is  known 
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from  (A.7),  ^2  can  b«  found  to  be 

+^i‘,  i  - 1.2 


where  3,  is  some  known  matrix. 

Substitution  of  (A.8)  into  the  equation  for  Xl}1  jives 


+  +  U-1.2,  i+i 


(A.3) 


(A.9) 


where 

A.  -Ac-BoM.  +BoA;'GuA;XB'v&2  +  8UKu-&J4.1-B'ltfi:'RiM.  (A.10) 


A  -  -Bo^csiOrs+BSA  -AA4]+a»A;,0;j#,A^«. .  (a.id 

Ai  *  Ai  ~  (3i  jA,i  1  Of,.  (a.  12) 

To  find  conditions  for  A,.'  and  XjV  to  exist  and  be  unique  we  apply  the  Kronecker 
product  operator  to  (A.9)  to  jive  the  vector  form 

a^ku  +  atktt-r,  (A.13) 

jMm  +  SMu*'**  (A.  14) 

Then  if 


(A.  15) 


is  ooa-singular  XT,  and  XVi  exist  and  are  unique. 

The  existence  of  higher  derivatives  follows  in  an  analogous  manner  and  existence  and 
uniqueness  are  guaranteed  by  An  and  (A.  15)  non-singular.  Instead  of  giving  a  specific 
manner  in  which  a  unique  solution  exists  to  (A.9)  we  could  just  specify  that  if  there 
exists  a  unique  solution  to  (A.9)  then  the  power  series  exists  and  is  unique. 


Appendix  B:  Proof  of  Theorem  U 
Represent  P„  as 


Then  denote 


P„ 


’  P  .(**) 

mP'.iIim) 


aP,i(aV 

dFjld).  ’ 


Fi' 


»?*(»> 1 
9a' 


a.  2;  /-  1.2. 


k  -  1. 2. 3. 


Substituting  of  (B.l)  into  (26)  at  **  -0  gives 


0  -  PffCA,,  - Bu*Vt,  - B„MJ+ PSJ[A„  - S-ffH,  - Bt„H.] 

+[A„  -  fltiMu  -  B^rPi?  f  [A„  -  B„K  -  B,(1Vf,  JT?'  -  6 
o  «  PIT  A, 2  +  FT  A  a  -p[A„  -  BmH,  -  B^HJPJT 
0-PffA*+A4,Pff. 


If  A,-  4  stable  then 


PlT-0 


(B.l) 


(B.2a) 

(B.2b) 

(B.2c) 

(B.3) 
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is  the  unique  solution  to  (B.2c).  Substitution  of  this  into  (B.2b)  gives 

P5?  *  -Pii'AuAJj.  (B.4) 

Finally,  substitution  of  (B.4)  into  (B.2a)  gives 

0 - P!?tAo - S«iVi,  - Bo^MAo - BtM.  - Bo.AfJPl? * £,  t,;-  1,2;  i#/.  (B.5) 

Since  [Ao  -  -  Bo* M*]  is  stable  if  the  slow  game  possesses  a  unique  stabilizing  pair 

Klt,  Ku,  (B.5)  has  a  unique  solution.  Hence  the  first  term  in  (B.l)  exists  and  is  unique. 

We  next  examine  the  existence  and  uniqueness  of  the  second  term  in  (B.  1).  Substitute 
(B.l)  into  (26)  and  take  the  partial  with  respect  to  u  at  n  «0.  This  gives 


0  -  PlT[Au  +  8,M.  -  BuA4]+Pffi&4*  -  B-tM.  ~  BztMg] 

-B^MgJPV  (B.6a) 

0  -  Pl!'Al3 + Pj?  A« +CA,,  - B-iM,  ~  BsHJPff 

+(Au -  B„M.  -  B„A4JPIT  (B.6b) 

0  -  PIT  A„  +  A^PIJ1  +  [P!fAw  + AUPffl  4/- 1.2;  i*  j.  (B.6c) 

Since  PIT  are  known  from  the  calculations  for  the  hist  term  in  the  expansion,  if  AB  is 
stable  (B.6c)  possesses  a  unique  solution.  Then  PIT  may  be  found  as 

PIT--PaA,1AJ,,-5'Aa.  i-1.2  (B.7) 

where  y  is  a  known  matrix.  Substitution  of  (B.7)  into  (B.6a)  gives 

0  -  PI!Ta„ - BgM.  - + [A0  - BoM,  -  B^VfJPfi'  *  (B.8) 


where  ^  is  a  known  matrix.  If  (Ao  -  B«M,  -BMVf„]  is  stable  then  (B.8)  possesses  a 
unique  solution.  Hence  the  second  term  in  the  series  exists  and  is  unique.  Higher  order 
terms  follow  easily  and  have  the  same  requirements  for  existence  and  uniqueness.  Since 
each  term  of  the  series  exists,  dearly,  there  is  a  £*>0  small  enough  to  guarantee 
convergence  of  the  series  for  all  0st*<£* 


Appendix  C:  Proof  of  Theorem  CJ 

Subtracting  (22)  from  (26),  we  obtain  a  Lyapunov  equation  for  W,  *  P„  -K,, 


An  “  -  BijM,, 

At2“ 

BX,M„ 

—  [An  -  BuMg  -  BziMg] 

M  - 

[Bn'H, +  B„M(f] 

4- 

6-0,.  i  o' 

BuMh+Bx/Mh  :  0 

r  b„h.+b„h,  -  o' 

0  ;  6 

l ,  : 

-[BvW,  +  BZ)Mg]  ;  0 

—  +  BtiMf,  j  j  0 

-r { £B,  +  p™-] } M,  +  Of { &B, -- J  -M&M  +M1RM  -0.  (C.l) 

ft,  possesses  a  power  series  expansion  about  n  -  0  since  P„  and  K,  possess  a  power 
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series  at  *  0.  VV  can  be  expanded  as 

£[■*«?  ^'1  ,-.12 
'  A  /!  Lw«r  istfg} 

If  and  the  power  series  expansion  for  K,  are  substituted  into  (C.l)  we  get  at  js  »  0 

tffftA,,  -  BnAfc  -B„*4]+CA«  -  B„M.  ~ 

+  WlSt A, ,  -  B,M.  -  BnA4  ] +C A„  -  BiM.  -  JhMj&g  -  0  (C.3) 


(C.2) 


S'  An  +  Aa  W*  m  0 


and 


#1?A„  +  *?An+[An  “  Bv\i*  - BvSil.J1r!f  -  0. 

Since  As  is  stable  (04)  implies  that 

vJiS’-o. 

Substitution  of  (C.6>  into  (05)  gives 

tZK<n  _ _ tjErtoj  A  a-' 

"it  *  "it  Anna. 

Finally,  substitution  of  (.07)  into  (C.3)  gives 

0*  WlStAo-BotM,.  ■“BosAfi.J+fAo- BonVfi,  ~ BojiVfi,],Wl°\ 

The  matrix  [Ao  -  Ba,M„  -  BnMu]  is  the  feedback  matrix  of  the  slow  subsystem  (6) 
which  is  stable.  Hence 


(C.4) 

(05) 

(06) 

(07) 

(08) 


^*0,  t-1.2, 

which  implies  that 

i  »  1, 2. 

Thus  we  have  proven  Theorem  HI. 


(09) 

(C.10) 


iommti  of  Tbw  PmnkUa  lomtuta 


non  transaction*  on  automatic  control,  vol.  ac-24,  no.  J,  ocroaas  1979 


Feedback  and  Well-Posedness  of  Singularly 
Perturbed  Nash  Games 

HASS  AN  K.  KHALIL  and  PETAR  V.  KOKOTOVIC,  senior  member,  ieee 


wRh  skw  Mi  tmt  maim  Skgekr  partmbuthm  k  —played  to  i*flan  a 
Nmh  g— a  pkyed  oa  the  Ml  mM  by  a  gaaw  played  oa  *  ntaM  aider 

—to  Mteck  klaw— lea  MHn  k  camHmtA.  A a  Impirtiat  wMw 
betwaea  the  MMd  Men— fea  mmbm  aad  the  MH-ftMtei  of  Ik 
g— a  k  fo aad  mi  am 4  M  co^sctur*  social  caaco  whca  the  Urn 


I.  Introduction 

JN  THIS  paper  we  consider  a  two-player  linear- 
quadratic  Nash  game  for  systems  with  slow  and  fast 
modes.  Linear  time-invariant  models  of  many  physical 
systems  contain  slow  and  fast  modes.  Control  problems 
for  such  models  are  ill-conditioned  and  have  motivated 
several  model  simplification  approaches  [1],  [2]  which 
neglect  fast  modes.  In  the  singular  perturbation  method 
[3]  both  sic  v  and  fast  modes  are  retained,  but  analysis 
and  design  problems  are  solved  in  two  stages,  first  for  the 
fast  and  then  for  the  slow.  We  define  two  subgames,  one 
for  the  slow  modes  and  one  for  the  fast  modes,  and  obtain 
their  open-loop  and  linear  memoryless  closed-loop  Nash 
solutions.  Then  we  analyze  the  asymptotic  behavior  of  the 
Nash  solution  of  the  original  game  for  different  assump¬ 
tions  of  the  feedback  information  available  to  the  players. 
In  particular,  we  show  that,  for  a  first-order  approxima¬ 
tion,  the  open-loop  Nash  solution  of  the  original  game 
reduces  to  the  sum  of  the  open-loop  solutions  of  the  slow 
and  fast  games.  For  a  linear  memoryless  partially  closed- 
loop  Nash  solution  (closed-loop  in  slow  variables  only),  it 
is  shown  that,  for  a  first-order  approximation,  the  solution 
of  the  original  game  reduces  to  the  sum  of  the  linear 
metnoryless  closed-loop  Nash  solution  of  the  slow  game 
anr>  the  open-loop  Nash  solution  of  the  fast  game.  Finally, 
in  view  of  this  analysis  and  of  the  work  of  Gardner  and 
Cruz  [4]  on  the  closed-loop  Nash  solution,  we  discuss  the 
well-posedness  of  Nash  games  in  general  and  illustrate  the 
impact  of  the  feedback  information  available  to  players 
on  the  well-posedness  of  the  game. 

Manuscript  received  March  31,  197$;  revised  January  22,  1979  and 
March  30.  1979.  Paper  recommended  by  D.  D.  Siljak.  Chairman  of  (he 
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II.  Slow  and  Fast  Subproblems 

We  consider  a  singularly  perturbed  linear  time-in¬ 
variant  system 

i-^„Jt  +  /4,2z  +  R„u,  +  R12u2,  x(0)-x0  (la) 

^i«/42,x  +  ^22z  +  B21u,  +  B22u2,  z(0)-zo  (lb) 

where  dim*  — n,,  dimz-n2,  dimu,  —  mi.  The  small  singu¬ 
lar  perturbation  parameter  p>0  represents  small  time 
constants,  inertias,  masses,  etc.  The  vector  z  is  “fast”  since 
its  derivative  i  is  of  order  1/ju  which  is  large.  The  ith 
player  chooses  his  strategy  u,  to  minimize  his  performance 
criterion 

J,m  jfo  (y,yi-*-u;Ri/ui  +  uJRt/uy)dt,  i*j  (2) 

where  Ru  >0,  Ru  >  0,  and 

m  Ctlx  +  C,2z-  (3) 

A  Nash  equilibrium  solution  of  this  game  is  a  pair  (uf.ttj) 
such  that 

i+h  '“1.2  (4) 

for  all  admissible  u(.  A  slow  subsystem  is  formed  by 
neglecting  the  fast  modes,  which  is  equivalent  to  letting 


ft-0  in  (1), 

iJ-/4ux1  +  i4,2z1+tf,,“u+5i:«2i>  x,(0)-x0  (5a) 

0—  *42|*,  +  ^22zs  4"  &2\uls  4“  ^72u2j  (5b) 

yt,-Cn*,+  Cazs.  (6) 

Assuming  that  Aa  is  nonsingular,1  we  express  z,  as 

zsm  “^22lM2rx»+,^2iMu  +  R22«2j)  (7) 

and,  substituting  it  into  (5)  and  (6),  we  define  the  slow 
subsystem  of  (1),  (3)  as 

*,-.40*1  +  £0imi,  +  R02«i2,,  *,(0)-*„  (8) 

y*  -  +  Dnuu  +  D.jUj,  (9) 

where 


'If  Au  i*  singular,  the  variable*  in  the  null  space  of  A„  are  not  fast 
variable*.  A  reformulation  of  the  problem  which  include*  tneee  variable* 
in  the  jt-vec tor  will  lead  to  noniingular  Aa. 
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-^0  II  —  ^  I2^22*-^2I»  R<MmRU~A  12^22 '^2i 

Cnm  Clt  —  j,  Dy»  —  CqA^ 'By  *Jm  1*2> 

(10) 

A  fast  subsystem  is  derived  by  assuming  that  the  slow 
variables  are  constant  during  fast  transients,  that  is,  z,  »0 
and  x,  -a  constant.  Letting  zf~z-za,  uy- u,-u„,yv» y, 
-yu  the  fast  subsystem  of  (1),  (3)  is  defined  as 

■^r  -  Anzf+  B21uxj+  Bnuv,  z/0)  -  z(0)  -  z,(0) 

(11) 

ytfmCnzf  (12) 


such  that  x,(f)-*0  as  f-*oo  and 

/  x;(t)x,(0<*<oo  (16) 

where  x,(f)  is  the  solution  of 

x,^A<yxJ+  B0luh(t)  +  Bfau^t). 

The  admissible  closed-loop  strategies  are  defined  similarly 
except  that  u,~u,(t,xt).  With  strategies  restricted  to  this 
admissible  class,  the  finite-time  necessary  conditions  can 
be  extended  and  used  for  infinite-time  problems,  as  it  is 
done  in  this  paper. 

An  open-loop  Nash  solution  («°L(r),« 2L(0)  of  the  slow 
game  must  satisfy 


where  r-f/p  is  a  stretched  time  scale.  Following  the 
treatment  of  the  optimal  regulator  problem  [5],  our  ap¬ 
proach  is  to  extract  from  /  two  quadratic  performance 
criteria,  one  for  the  variables  of  the  slow  subsystem  (8) 
and  the  other  for  the  variables  of  the  fast  subsystem  (11). 
We  formulate  two  subgames. 

Slow  Nash  Game 


x,  -  AqX,  +  fl01u„  +  x,(0)  -  xo,  x,(t)—Q  as  t—o o 

(17) 

(*,  +  D;,Du)u°l+  D;iDljU%L  +  D'iCi0x?L+  0, 

i+J  08) 

~  h£x‘mA'j£L+  C/J)Cj0x®L+  Cj0(Z)MM°L+  DyT^>L), 

A°L(/)->0as/-*oo.  (19) 


Find  a  Nash  equilibrium  solution  (u*f,uy)  of 

/ii m  2  Jq  [ ‘*"2xJC;o(/)(Iuit  +  DyUp) 

+  2ui,DiDvup  +  ub(/{H  +  D!tDu)uu 

+ ujs(Rv  +  DyD^Uj,} dt,  i+j,  ij— 1,2  (13) 

for  the  slow  subsystem  (8).  The  expression  for  J„  is 
obtained  by  formally  substituting  (7)  into  (2). 

Fast  Nash  Game 


Assuming  that  the  matrix 

R- 


Rti  +  D’tlDi2 

D22D2I  R22  +  D22D22 


(20) 


is  nonsingular,  (17),  (18),  and  (19)  can  be  rewritten  as 


d_ 

dt 


*,OL 

rOL 

XEL 

-  V 

*£L 

A2L 

/2\ 

(21) 


Find  a  Nash  equilibrium  solution  (u^,u^)  of 

1  Z*00 

J,/m  J  )0  (*/Qca*/+  “//*«“//+  UjjRyUjj) dr t  i+j 

(14) 

for  the  fast  subsystem  (11). 

Necessary  conditions  for  Nash  solutions  have  been 
derived  in  [6],  [7]  using  variational  techniques.  Unlike  the 
optimal  control  problem  (case  of  one  player),  the  Nash 
equilibrium  strategy  for  two  or  more  players  has  different 
open-loop  and  closed-loop  solutions.  Thus,  the  closed- 
loop  Nash  solution  cannot  be  obtained  by  solving  the 
open-loop  Nash  game  for  every  initial  point,  which  is 
valid  in  the  optimal  control  problem.  The  conditions  of 
[6],  (7]  would  be  directly  applicable  if  the  problems  (13) 
and  (14)  were  for  a  finite-time  interval.  Since  (13),  (14)  are 
infinite-time  problems,  the  admissible  strategies  are 
limited  to  those  for  which  the  state  vector  converges  to 
zero  as  /-*«.  For  example,  the  admissible  open-loop 
strategies  for  the  slow  Nash  game  are  square  integrable, 
i.e„ 

f  u'it(t)u(t(t)dt<  x 


We  assume  the  following. 

Assumption  1:  There  exists  a  unique  pair  (u°L(r),  u2L(r)) 
satisfying  (17),  (18),  and  (19). 

Assumption  2:  The  matrix  V  has  no  eigenvalues  with 
zero  real  part,  that  is. 

|ReA(  K)|  >0.  (22) 

A  closed-loop  Nash  solution  (u^f.x,),  «£L(r,x,))  of  the 
slow  game  must  satisfy  (17),  (18),  and 

“  “  A^L  +  QC^xfL 

+  Ci(Drf-,  £>,«“)  +  ( 

•  [  ( Rn + D,jD,J')uj^L+  d:,d„u^ 

+  D/C,t(xJCL+SoyAjL], 

»>*/',  \?"(»)-*0  as  t-*oo.  (23) 

The  solution  of  (17),  (18),  and  (23),  if  it  exists,  is  in  general 
not  unique  [8].  To  avoid  this  nonuniqueness  problem  we 
restrict  ourselves  to  a  class  of  solutions  in  which 

A^r.xf1)-  A^xf*-(f)+g^(r) 


(15) 


(24) 
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where  is  an  n,xn,  symmetric  matrix.  Subsequently, 
u£L  takes  the  form 

uft(r,xfL)-ii,ax;cl-(i)  +  ^1(/).  (25) 


Substituting  (24),  (25)  into  (17),  (18).  and  (23),  and  sep¬ 
arating  the  variables  we  find  that  Ku,  Fa  satisfy  the 
algebraic  equations 

0-(*u  +  D'DJFa+  D'AjFj,  +  A;Q+  B^Ku, 

>*j  (26) 

0™  /CjJ/4(j+ A'qKu  +  0,(7*,+  Kit(BojFil+  B^ F}t ) 

+  CHDUF„  +  !><,/>)  +  +  D!jDij)Fj, 

+  d;jdiifu+d;jci0+bM,  i+j  (27) 
while  gu(t),  hu(t)  satisfy  the  equations 

0-(Ru  +  D;DJhJt)+  D'tD,JhjJ(/)+ 

•  +j  (28) 

~Lm  *!>&,(  0  +  K(B<kK(0 + VM /)) 

+  Q(Z>A(0+AA(')) 

+  /2[(i^+  D/jDjhjiiO+DIjDMt) 

+  soy*«(')].  «*./»  gi,(/)-»Oasr-»oo.  (29) 

Using  (28)  to  eliminate  /iu(r)  from  (29)  we  find  that  gu(/), 
g2j(0  satisfy  a  homogeneous  equation 


8., 

82, 


-  M' 


8., 

82, 


gu(t)-*0  as  f-»oo.  (30) 


We  assume  the  following. 

Assumption  3:  There  exists  a  unique  solution 


(KiJ,K2j’Ft,<Fla)  of  (26)  and  (27)  such  that 

Re  (A(/f0+  B0iFX]  +  B^Fjj)}  <0. 

(31) 

Assumption  4: 

Re(\(W)}<0. 

(32) 

Assumptions  3  and  4  guarantee  that  in  the  class  of  linear 
memoryless  closed-loop  solutions  of  the  form  (25)  there 
exists  a  unique  pair  (u£L,u£L)  given  by 

u£L(x,j)- F„x,(t). 

(33) 

An  open-loop  Nash  solution  (u°L(T)>“yL(T))  of  the  fast 
game  must  satisfy 


'm*22:f  +  fl2l“l/  +  B22Ulf  O_Z,(0)- 


zf(r)—0  as  t-*oo  (34) 

-R-'Bi  A°L(r) 

(35) 

*  22^r/ L  +  ^i2^i2:f>L- 

\/L(t)-»0  as  t-*oc. 

(36) 

Assumption  5:  There  exists  a  unique  solution 
(upyL(T), «^L(r)>  of  (34),  (35),  and  (36). 

Assumption  6:  The  matrix 


D- 


*22 

~  ^12^12 
~  ^22^22 


“  ^21^11  '®21 
~  *  22 
0 


-BuRkBu 

0 

~  *22 


(37) 


has  no  eigenvalues  with  zero  real  part. 

We  now  want  to  investigate  the  relation  between  the 
Nash  equilibrium  solution  of  the  original  game  (u*,u*) 
and  the  Nash  equilibrium  solutions  of  the  slow  and  fast 
games  defined  above.  To  see  what  we  want  from  such  an 
investigation  let  us  recall  a  similar  optimal  control  prob¬ 
lem.  It  has  been  shown  in  [5]  that  the  optimal  control 
u*(t,p)  satisfies  the  relation  u*(/,yi>  —  «*(/)+  u*(t)+0(p) 
for  all  t  >  0,  where  u*(t)  and  w/(r)  are  the  unique  stabiliz¬ 
ing  solutions  of  slow  and  fast  subproblems  defined  in  a 
way  similar  to  our  slow  and  fast  subgames.  This  means 
that  for  sufficiently  small  ft  one  can  replace  the  optimal 
control  by  the  sum  of  the  slow  and  fast  controls,  thus 
solving  two  lower  order,  well-conditioned  problems  in¬ 
stead  of  solving  the  original  ill-conditioned  problem. 
Other  advantages  of  this  near  optimal  design,  like  allow¬ 
ing  the  ignorance  of  the  value  of  ft  and  achieving  0(  ft2) 
approximation  in  the  value  of  the  performance  criterion, 
are  discussed  in  [5].  Moreover,  for  all  r>0,  lim^M’f'.ft) 
« u*(t),  that  is,  for  all  i  except  t-0,  the  solution  of  the 
original  control  problem  tends  to  the  solution  of  the  slow 
problem  as  ft-»0.  Thus,  neglecting  ft  either  in  modeling 
the  system  or  in  the  exact  solution  leads  to  the  same  lower 
order  solution.  A  problem  which  has  this  property  is  said 
to  be  well-posed,  since  the  design  algorithm  is  not  too 
sensitive  to  modeling  errors,  a  property  which  a  practical 
engineer  intuitively  requires. 

The  Nash  solution  does  not  always  have  this  property. 
Gardner  and  Cruz  [4J  have  shown  by  a  counterexample 
that  the  closed-loop  solution  of  a  Nash  game  does  not 
tend  to  the  closed-loop  solution  of  the  slow  subgame  as 
ft— *0.  It  is  important  to  understand  why  the  closed-loop 
solution  of  the  Nash  game  fails  to  possess  the  desired 
well-posedness  property.  The  answer  is  to  be  sought  in  the 
difference  between  open-loop  and  closed-loop  solutions  of 
a  Nash  game.  When  analyzing  asymptotic  behavior  of 
solutions  one  should  be  careful  not  to  confuse  solutions 
corresponding  to  different  feedback  information.  For  ex¬ 
ample,  if  we  are  looking  at  the  open-loop  solution  of  the 
original  game,  we  should  not  compare  its  limit  to  the 
closed-loop  solution  of  the  slow  game.  In  other  words, 
both  the  original  and  slow  games  should  be  solved  under 
the  same  assumption  about  the  feedback  information 
available  to  the  players.  One  obvious  case  is  the  open- 
loop.  If  we  solve  the  open-loop  original  game,  then  wc 
expect  its  solution  to  tend  to  the  open-loop  solution  of  the 
slow  game  as  fi— *0.  This  open-loop  problem  is  investi¬ 
gated  in  Section  III.  Now  let  us  assume  that  the  slow 
game  has  been  solved  under  the  assumption  that  x,  is 
fedback,  that  is  we  have  the  closed-loop  slow  solution.  We 


We  assume  the  following. 
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want  to  identify  a  solution  of  the  original  game,  which,  in 
the  limit  as  p-»0,  has  the  same  feedback  information  as 
the  closed-loop  slow  solution.  Since  we  usually  require  the 
closeness  of  x  and  x,  for  sufficiently  small  p  we  expect 
that  such  a  solution  should  assume  that  x  is  fedback. 
What  about  the  feedback  of  z?  If  we  assume  that  z  also  is 
fedback,  that  is,  seeking  a  closed-loop  solution  of  the 
original  game,  then  we  would  have  changed  the  feedback 
information  assumption  between  the  slow  and  original 
games  because  a  feedback  from  z  contains  information 
about  the  fast  dynamics  of  the  system,  something  which  is 
not  available  in  the  slow  game.  This  means  that  the 
original  problem  which  has  the  same  feedback  informa¬ 
tion  as  the  closed-loop  slow  problem  is  a  partially  closed- 
loop  game  in  which  only  x  is  fedback.  This  partially 
closed-loop  Nash  solution  is  investigated  in  Section  IV. 

III.  Open-Loop  Solution 

An  open-loop  Nash  equilibrium  solution  of  the  original 
game  (1)  and  (2)  must  satisfy 

x-Aux  +  Ai2z+  Bnttx  +  Bl2u2,  x^-xo,  x(r)-*0 

as  f— *oo  (38) 

jui-^„x+^jjz  + r(0)-2o,  z(/)-» 0 

as  *oo  (39) 

+  +  (40) 

~\“i4'n\  +  ^2|P(+  C/,C(lx  +  CnCi2z,  \(/)— *0 

as  /-* oo  (41) 

—  HPi  “  A  +  A'jjp,  +  C‘2Cnx  +  CftCjjZ ,  p,(i)—*0 

as  f-*oo.  (42) 

The  relation  between  the  solution  of  the  two-point 
boundary  value  problem  (38)— (42)  and  the  open-loop 
solutions  of  the  slow  and  fast  games  is  established  in  the 
following  theorem. 

Theorem  1:  Under  Assumptions  1,2,5,  and  6  there  ex¬ 
ists  ji*>0  such  that  for  every  p€(0,p*J,  (38)-(42)  possess 
a  unique  solution 

xOL(  t ).  rOL(  f ),  u,OL(  0.  'n°L(  *  )•  P,OL(  I ) 

such  that 

u(OL(/)-^L(/)+^L(r)+0(M),  Vr>  0.  (43) 

This  theorem,  which  is  proved  in  Appendix  A,  suggests 
that 

•THQ-tfiO  +  tfir),  /- 1.2  (44) 

may  be  used  as  an  approximation  of  the  exact  open-loop 
equilibrium  strategy  («fL(0,M°L(t)),  although  it  is  not  a 
Nash  strategy.  To  justify  its  use  as  an  approximation  of  a 
Nash  strategy  we  suppose  that  Player  2,  for  example,  uses 
the  approximate  strategy  u2OL(t)  and  pose  the  following 
question.  Does  there  exist  a  strategy  u,(/)fkuAOL(0  such 
that  /,(«,, #fOL)</,(«,AOL,«^OL)?  Or,  in  other  words,  can 


Player  1  benefit  by  deviating  from  u*OL'!  The  answer  is 
given  in  Theorem  2  which  establishes  the  “asymptotic 
Nash”  property  of  the  approximate  strategy  (maOL,maol). 
Theorem  2: 

y1(«,AOL,u/AOL)  </.(»..«, aol)+0(m)  (45) 

for  all  admissible  ultj*i,  ij •  1,2. 

In  words,  the  theorem  states  that  neither  player  can 
benefit  by  more  than  0(  p)  if  he  unilaterally  deviates  from 
the  approximate  open-loop  strategy.  In  the  limit  as  m-*0, 
the  approximate  strategy  has  the  Nash  property,  i.e.,  it 
satisfies  an  equality  similar  to  (4). 

Proof:  Using  (43)  it  is  straightforward  to  show  that 

/i(“fOL, “AOL) •  J& **?L< U?L)  +  0( p),  /-1.2  (46) 

«,AOL)  -  U?L) +<K  p)  <47) 

for  all  admissible  u(,j+i,  ij~  1,2. 

Consider 

y,(uAOL,  <OL)  -  y,(u„  <OL) + y,(«AOL,  «,AOL) 

«,AOL) + y,(  «,OL)  -  /,(  u°L,  u°L) 

for  any  admissible  u,.  From  (4)  we  get 

/,(«,AOL,  «,AOL)  <  M*.  «^OL) + y,(  u,AOL,  u^)  -  j,(  «°L,  u°L) 

Using  (46)  and  (47)  proves  (45). 

IV.  Partially  Closed-Loop  Solution 

When  only  x  is  available  for  measurement  we  seek  a 
partially  closed-loop  Nash  equilibrium  solution  of  the 
original  game  (1),  (2).  It  is  assumed  that  each  player  has 
access  to  the  current  value  of  x(r)  with  no  recall  of  past 
values,  a  memoryless  partially  closed-loop  information 
structure.  To  complete  our  definition  of  the  information 
structure  we  need  to  state  which  part  of  the  initial  condi¬ 
tions  x0 ,z0  will  be  known  to  the  players.  Let  us  recall  that 
in  open-loop  solutions  the  players  know  the  initial  condi¬ 
tions  Xq,;^  while  in  memoryless  closed-loop  solutions  they 
do  not.  In  partially  closed-loop  solutions  the  players 
should  be  provided  with  open-loop  information  concern¬ 
ing  z.  Such  information  includes  not  only  z0  but  also  x0, 
because  the  initial  conditions  z^ 0)  of  the  fast  subsystem 
depend  on  both  x0  and  z0  as  it  can  be  seen  from  (11).  In 
summary,  u,PCL<- uj(/,x(r),x0,z0). 

The  partially  closed-loop  solution  must  satisfy  (38), 
(39),  (40),  and  (42)  as  in  the  open-loop  case,  while  (41)  is 
replaced  by 

-\mA’n\  +  A'2lp,  +  C/,C,,x  +  C,\  C,2z 

+(§)'[ v,+fl;Ai+ Bv^ ) •  *•  <«*> 

The  difference  between  (48)  and  (41)  is  in  the  presence  of 
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the  term  du^/dx  which  allows  for  the  possible  dependence 
of  Uj  on  x.  We  restrict  ourselves  to  a  solution  in  which 
Pi  take  the  form 

\(t,p,x,x0,z0)-Ki(  p)x(t,p)  +  g,(t,p,x0,z0)  (49a) 
pAt^X'X^Zo)  -  Pf  p)x(t,p)  +  qXe^XoiZo).  (49b) 
Equation  (40)  shows  that  u,  takes  the  form 

ui(t,ii,x,x0,z0)- Ft(  p)x(t,p)  +  hi(t,p,xi),z0)  (50) 

where  F,  and  A,  are  functions  of  Kit  P„  g,,  and  q{.  Equa¬ 
tions  (38),  (39),  (40),  (42),  and  (48)  can  now  be  replaced  by 

•*“(^11+  2  +  2  B\A>  x(0)mx» 

x(/)-»0  as /-»oo  (51) 

/  i  \  2 

M*  -  ^ si +  2  BvF, y  +  Auz  +  2  Bvht>  x(0)  -  zv 

z(t)-*0  as  t-*oo  (52) 
0-  (*uFi  +  B'uKt  +  BiiP,)x  +  Ruhi  +  BU  +  B^q,  (53) 
~  ( Ktx  +  ft)  ■  (A ;  +  A  i,F,) X  +  A  ft  +  A'2Kqt 

+  CnC„x  +  CuC/jZ 
+F;[(*iJFy+B;JKl+ByPi)x 
+  Rijhj  +  b;j&  +  B‘yqt  ] ,  &(/)— Oasr-oc 

(54) 

-  p(  Rx  +  q,)  -  ( A \2Ki  +  A'22Pi)x  +  A'l2gi  +  A^q, 

+  Ci2C,iX  +  Ci2Cj2z ,  <7,(0— *0  as  /— »oo.  (55) 

Investigation  of  (51)— (55),  which  is  carried  out  in  Appen¬ 
dix  B,  leads  to  the  following  theorem. 

Theorem  3:  Under  the  assumptions  of  Lemmas  B 1  and 
B2  there  exists  ft*  >0  such  that  for  every  p£(0,p*],  (51)- 
(55)  possess  a  solution  xPCL(t),2rcL{t),ufCL(t,xfC1')  such 
that  for  all  r>0 

xpcl(/,(i)-x,cl(0+0(m)  (56a) 

*KL( M)  -  zfHO  +  zfOL(r)  +  p)  (56b) 

ulKt-(t,p,xrcL)  -  /vJx,‘CL(r,(i)  +  u£l(t )  +0(  |x).  (56c) 

Theorem  3  establishes  the  existence  of  a  partially  closed- 
loop  solution.  We  cannot  claim  the  uniqueness  because 
the  information  available  to  each  player  includes  the 
initial  conditions  x<y,  z0  allowing  each  player  to  generate 
x(t)  in  the  open-loop  term  h,  of  (50).  Thus,  the  separation 
of  variables  technique  used  in  Appendix  B  is  one  but  not 
necessarily  the  only  way  to  construct  the  solution  [8], 
Theorem  3  suggests  that 

«,AfC  -  F„x  +  u$L(  r),  i-  1.2  (57) 

may  be  used  as  an  approximation  of  the  constructed 
partially  closed-loop  solution.  The  validity  of  such  ap¬ 
proximation  is  established  in  Theorem  4  which  shows  that 
the  approximate  strategy  (uAPC,uAf>c)  has  the  “asymptotic 
Nash"  property. 


Theorem  4: 

Ji(u*rc,UjAPC)  <y/(‘‘i.«‘yAPC) +°(  M)  (58) 

for  all  admissible  uiyj+i,  i,jm  1,2. 

Proof:  Let  xA(t),zA(t)  be  the  trajectory  resulting 
from  applying  uAPC,aAPC  to  (1),  then  xA,zA  satisfy 

2  BuF^xA(t)  +  AxlzA(t) 

+  2  Buu!fL(T)j  xA(0)-xo  (59a) 

1-1 

M-^--|^2i+  2  BuF^xA(t)  +  AnzA(t) 

+  2^«°L(r),  ^(O)-ro.  (59b) 

i-i 

Using  standard  singular  perturbation  techniques  [5]  it  can 


be  shown  that  for  all  /  >  0 

xA(t)-xfL(t)+0(it)  (60a) 

zA(t)m  z^L(t)  +  z°L(r)  +  0(  p).  (60b) 

Hence, 

x^O-x^HO  +  IHm)  (61a) 

zA(t)»zfCL(t)+  0(p)  (61b) 

uAPC(t)  —  u,PCL(t)  +  0(  (a).  (61c) 

Now  it  is  straightforward  to  show  that 


J,(  u^,  u2apc)  -  «/((«rCL,  u^1-)  +  0(  p),  /-  1,2.  (62) 

Using  a  similar  argument  it  can  be  shown  that 

Fiiui’  ufK)  m  Fi(  ui<  MyPCL) +  0(  M)  (63) 

for  all  admissible  ut,j=Pi,  i,j~  1,2.  The  rest  of  the  proof  is 
similar  to  the  proof  of  Theorem  2,  and  is  omitted. 

In  many  engineering  applications  only  feedback  strate¬ 
gies  are  allowed.  For  such  applications  the  approximate 
strategy  (57)  is  not  satisfactory  because  it  contains  an 
open-loop  term  u°L(r).  However,  in  an  important  special 
case  this  term  can  be  neglected. 

Lemma:  If  the  assumptions  of  Lemmas  B1  and  B2  are 
satisfied  and  if 

Re  {*(,!„)}  <0.  (64) 

then  the  application  of  the  reduced  strategy 

»ir~Fax,  i-l,2  (65) 

to  the  actual  system  (1)  results  in 

JXu^-JXu^.u^+Oipl  /— 1,2.  (66) 

Moreover,  the  reduced  strategy  has  the  “asymptotic 
Nash”  property 
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J,(Utr'UJr)  <MUi>Ujr)+(Kn ) 

(67) 

for  all  admissible  ij  ™  1,2. 

Proof:  Let  xr(f),z,(f)  be  the  trajectory  resulting  from 
applying  to  (1),  then  xr,z,  satisfy 

*rm  l^ll  +  2  ^UFis  j-*r(0  +  A  I2*r(0. 

xr(0)-xo 

(68a) 

2,+  2  *2.** j*,(0  +  ^22^(0. 

^(0)  -  *<>• 

(68b) 

Using  standard  singular  perturbation  techniques  [3]  it  can 
be  shown  that  for  all  r  >  0 


J,~\j"(z^uf)dt  (73) 

J2m\fj>(z2  +  Ul)dl-  (74) 

We  investigate  the  well-posedness  of  open-loop,  closed- 
loop,  and  partially  closed-loop  Nash  solutions  of  the  two- 
player  game  (72)  to  (74).  The  open-loop  solution  is  given 
by 


«?L(/) -«?«-(/) 


0.-i(V3  -1) 


0 

1 

■  V3 

expr 

-1 

-V3 

1 

(75) 


*,(0-  *,CL(  t)  +  0(ix)  (69a) 

*,(')-  *,CL(  0  +  exp  [  A  nT  ]  zj(  0)  +  0 ( fi).  (69b) 


Hence, 

xr(t)  -x^HO-MXm)  (70a) 

z,(t)  -  z: "^(f)  +  exp  [  Aur  ]  z/0)  +  r/OL('. )  +  0(  ji) 

(70b) 

M')-“/PCL(0-«°L(T)  +  0(/i).  (70c) 

Lemmas  B1  and  B2  and  (64)  guarantee  that 

jT'expl^jj-i  jj/-0(M)  (71a) 

fo"z/OL(j'jdt- 0(m)  (71b) 

f^u^jdt-Oin)  (71c) 


for  any  fixed  /,  >0,  which  implies  (66).  The  rest  of  the 
proof  is  similar  to  that  of  Theorem  4. 

This  lemma  says  that  if  A  22  is  a  stable  matrix,  a  designer 
can  neglect  the  fast  modes  of  the  system,  - olve  a  closed- 
loop  Nash  game  for  the  slow  part,  and  apply  a  reduced 
strategy  (65)  to  the  actual  system  (1).  Doing  this  he  will  be 
sure  that  in  the  limit  as  /i-»0  he  is  approaching  a  Nash 
equilibrium  point,  however,  in  the  space  of  linear  mem¬ 
oryless  partially  closed-loop  strategies  rather  than  in  the 
space  of  linear  memoryless  closed-loop  strategies. 

V.  Example 
Consider  the  second-order  system 

x-z.  x(0)-V3  (72a) 

tii  m  -  x  -  z  +  w,  +•  uv  z(0)-l  (72b) 

with  performance  criteria 


For  sufficiently  jinall  /x,  (71)  can  be  expressed  as 
u?L(/)-w?L(f) 

-- j(V3  -l)[-e"/Vi  +2e-V3l/l‘]+0(n). 

(76) 

On  the  other  hand,  if  the  slow  and  fast  dynam.cs  of  the 
system  (72)  are  considered  separately,  slow  and  fast  games 
can  be  defined  as  in  Section  I.  The  open-loop  Nash 
solution  of  the  slow  game  is 

“°L(')-«£L0)«^(V3  -1)e"/vi  (77) 

while  the  open-loop  Nash  solution  of  the  fast  game  is 

u°L(t/n)-u°L(r/t i)--(V3  -  \)e~V3'/r  (78) 

Equations  (76),  (77),  and  (78)  show  that 
u,OL( f ) -  «°L( t)  +  u°L(t/ii)  +  0(  M).  0.  i*  1,2. 

(79) 

In  particular,  we  get  that  for  all  t> 0.  u,OL(i)-»«®L(/)  as 
\i~* 0.  Hence,  the  open-loop  Nash  strategy  is  robust 
against  the  inaccuracies  caused  by  neglecting  higher  order 
dynamics.  For  this  reason  the  open-loop  Nash  solution  is 
said  to  be  well-posed.  As  a  consequence  of  this  well- 
posedness  the  sum  of  the  open-loop  Nash  solutions  of  the 
slow  and  fast  gr  Ties  can  be  used  as  an  approximation  of 
the  open-loop  Nash  solution  of  the  full  game  in  the  sense 
of  Theorem  2. 

The  linear  closed-loop  Nash  solution  of  the  game  (72), 
(73)  and  (74)  is  given  by 


and  the  corresponding  values  cf  the  performance  criteria 
are 


JCL 
J 1 


(81) 


1 

IJ| 

i! 


ArtPitfcilrt’r. 
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A  slow  game  defined  as  in  Section  I  would  have  the  linear 
closed-loop  Nash  solution 

j(3-V2)jc, 

with 

-2). 

It  is  seen  that  the  limit  of  as  >i-*0  is  different  from  the 
value  of  at  ^-0.  This  discrepancy  between  the  J's  in 
the  neighborhood  of  ji—0  indicates  that  the  closed-loop 
Nash  strategy  yields  a  performance  criterion  which  is  not 
robust. 

Finally,  the  linear  partially  closed-loop  Nash  solution  of 
the  full  game  (72)  to  (74)  can  be  expressed  as 


ufCL-«JPCL 

|(3-V2)+0(^)]jc-(V3  -De-^-MK^) 


with 


limyiPCL- 4(3V2  -2).  1-1,2 


Section  IV  we  should  not  expect  uf1  to  be  the  limit  of  u,CL 
since  we  have  shown  that  it  is  the  limit  of  ulrcL.  However, 
there  are  special  cases  when  uf1,  tends  to  u^1  as  p-*0. 
Gardner  and  Cruz  [4]  have  reported  two  cases.  The  first 
case  is  the  zero  sum  game,  and  the  second  one  is  the  case 
when  Ca — 0.  Khalil  [9]  has  reported  a  third  case  in  which 
the  fast  vector  z  has  been  partitioned  into  two  weakly- 
coupled  subvectors  with  each  player  controlling  only  his 
subvector.  An  obvious  fourth  special  case  is  the  identical 
goal  game,  since  it  reduces  to  an  optimal  control  problem. 
The  existence  of  such  special  cases  raises  a  question  about 
additional  conditions  which  guarantee  that  u,CL  tends  to 
as  Since  is  the  limit  of  uf0-,  then  if  u,CL 
tends  to  u £*•,  it  should  be  true  that  in  the  limit  as  p-*0  the 
closed-loop  solution  and  the  partial  closed-loop  solution 
are  equivalent.  In  other  words,  the  fast  game  should  have 
the  same  Nash  cost  under  both  open-loop  and  closed-loop 
memoryless  information  structures.  All  the  four  cases 
reported  above  have  this  property.  We  make  a  conjecture 
that  whenever  the  fast  game  (11),  (14)  has  the  property 
that  its  Nash  cost  is  the  same  under  both  open-loop  and 
closed-loop  memoryless  information  structures,  the  linear 
memoryless  closed-loop  solution  of  the  original  game 
tends  to  the  linear  memoryless  closed-loop  solution  of  the 
slow  game  as  ji-*0. 


showing  that  the  partially  closed-loop  Nash  solution  of 
the  full  game  tends  to  the  closed-loop  Nash  solution  of 
the  slow  game  as 


Appendix  A 

Proof  of  Theorem  l:  Using  (40)  to  eliminate  u,,  we  write 
(38)  to  (42)  as 


VI.  Discussion 

We  have  pointed  out  that  a  study  of  the  well-posedness 
of  Nash  equilibrium  solutions  should  take  into  considera¬ 
tion  the  feedback  information  available  to  the  players  in 
both  the  original  and  slow  games.  We  have  identified  two 
cases  where  the  players  of  the  original  game  and  those  of 
the  slow  game  have  the  same  information.  The  first  case  is 
when  both  games  are  played  under  open-loop  assump¬ 
tions.  The  second  case  is  when  the  slow  game  is  solved 
under  closed-loop  memoryless  assumption,  while  the 
original  game  is  solved  under  partial  closed-loop  memory¬ 
less  assumption,  closed-loop  in  x.  In  both  cases  it  has 
been  demonstrated  that  the  Nash  equilibrium  solution  is 
well-posed.  This  leads  to  the  conclusion  that  Nash 
equilibrium  solutions  are  well-posed  as  long  as  the  origi¬ 
nal  game  and  the  slow  game  are  solved  under  the  same 
assumption  of  feedback  information  available  to  the 
players. 

In  their  investigation  of  the  closed-loop  solution  of  the 
original  game  [4],  Gardner  and  Cruz  have  shown  that  the 
linear  memoryless  closed-loop  solution  of  the  original 
game  (ufL.ufL)  satisfies  u,CL—  uu  +  u£L  where  u^L  is  the 
linear  memoryless  closed-loop  solution  of  the  fast  game. 
However,  uu  is  not,  in  general,  the  closed-loop  solution  of 
the  slow  game  defined  in  this  paper.  It  is  the  linear 
memoryless  closed-loop  solution  of  another  game  called 
the  modified  slow  game  [4],  In  fact,  in  view  of  the  result  of 
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and  D  is  given  in  (37).  We  transform  (Al),  (A2)  into  the 
separate  slow  and  fast  parts 


€, 

tv 

ii 

Vi 


.( A-BT ) 


ii 


-( D  +  nTB ) 


tv 


V, 


(A3) 


(A4) 


A-BD-'C-V, 

co*jco+0(m). 
Wo-z/O  +  OCm)- 


(AI3) 

(A14) 

(A15) 


The  transformation  used  is 


•(I-pST) 


L* 

J 

'  X 

z 

K 

-liS 

Pi 

^2 

pv 

tv 

X 

z  ' 

It 

-7* 

+ 

Pi 

Vi 

Pi 

where  T  and  S  satisfy  the  algebraic  equations 

0 -DT-C-)iT(A-BT) 

0  --S(D  +  nTB)+B  +  ?i(A-BT)S. 


(A5) 

(A6) 


(A7) 

(A8) 


Now  we  establish  the  existence  of  the  solution  of  (A  10) 
based  on  Assumptions  I  and  2.  Assumption  1  implies  the 
existence  of  a  unique  2/i,  x  n,  matrix  E  such  that  (21)  and 
x,(0)— (A',,(0),  A^(0))  -  x'qE  '  have  an  exponentially  de¬ 
caying  solution.  By  Assumption  2  the  eigenvalue  structure 
of  A  -  BD  ~  'C+0(  n)  is  the  same  as  that  of  A-  BD~  'C. 
Thus,  there  exists  a  unique  matrix  £—  £+0(/i)  such  that 
(A  10)  and  t^O)*^  (£i(0),£i(0))«oi£'  have  an  exponen¬ 
tially  decaying  solution.  This  establishes  the  existence  of  a 
unique  solution  of  (AI0).  Moreover,  (A14)  implies  that 


«*r)-*,OL(')+0(*0. 

$(')-*°L(')+ 0(M), 


V/>0. 


(A16) 

(A17) 


By  a  similar  argument  we  can  show  that  there  exists  a 
unique  solution  of  (All)  which  satisfies 


w{t)-z}>'-(t)  +  0{Ii) 

Vi(r)m\/L(T)  +  (Kn),  Vr>  0. 
Using  the  inverse  transformation  of  (A5),  (A6) 


Assumption  6  guarantees  that  for  sufficiently  small  p 
there  exist  unique  T  and  S’  satisfying  (A7)  and  (A8). 
Furthermore, 


x 

*2 


+  /l£ 


tv 

7i 

Vi 


r-f>-'C  +  0(fi).  (A9) 

'  z 

'  0  ' 

tv  ' 

Thus,  we  end  up  with  two  problems: 

r  .  t  r  t 

Pi 

,P2 

m-T 

ty 
ti . 
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Vi 

(A18) 

(A19) 


(A20) 

(A21) 


V 

V 

(, 

•  (A-BD-'C  +  O  (fi  )) 

€. 

completes  the  proof. 


tv 

tv 

7i 

-(Z)  +  0(M» 

7, 

72 

72 

o(0)  -  Do,  u(r)-»0. 
and  £,(/)-»0  as  t- »eo  (A10) 
w(0)-H-0>  w{t)-*0, 
and  iii{t)-*0as  /-*».  (All) 


Appendix  B 


Using  the  matrix  identity 
RCi'*ii  0 


We  investigate  the  necessary  conditions  of  partially 
closed-loop  solutions,  (51)— (55). 

In  its  present  form  we  cannot  separate  from  (51)— (55)  a 
set  of  algebraic  equations  that  should  be  satisfied  by 
K,,P„  Ft.  The  reason  is  the  dependency  of  z  on  x.  To 
overcome  this  difficulty  we  introduce  the  following  trans¬ 
formation: 


l-liML  -i 
L 


(Bl) 


~  *-12^12^22  '^22 


-  CiiDi\Rn  'ifj, 


^22”  ^22^22^22^22 


ri; 

where  L  and  M  satisfy  the  algebraic  equations 
0-  AUL  -(/!„+  2  £*£,)  -  pl\a  „  +  £  BUF,  -  A  X1L  j 

(B2) 

0-  - M{Aj2  +  uLA^  +  A,!* n^A,,+  2  BuF,-Aul}m. 

(B3) 

it  can  be  shown,  after  straightforward  calculation,  that  Now  we  can  separate  the  variables  by  equating  the  coef- 


rh*DI,Du  D\xDXi 
^22^21  Aj 2  +  D&D22 


$21 A  23*  0 

0  BnA’v' 

(A  12) 


[ 

[ 
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ficients  of  6  to  zero.  Doing  this  we  find  that  f^.P^F,,  and 
L  must  satisfy  (B2)  and 

0  ~RaFi+BilXi  +  BiiPi  (B4) 

0-*,|au  +  £  B^-AnL^  +  A'nKi  +  A'nPi 

+  Cl{Cn  —  CnCaL 

+  FjiRtjFj  +  B{jKt  +  ByP,),  i+j  (B5) 
0-pP^Au  +  .£  BuF-At2L^+A\2Kl  +  A'nPi 

+  CaCn  ~  CaCaL.  (B6) 

On  the  other  hand,  &,  <?,,  and  ht  are  obtained  by  solving 
the  equations 

2 

niv-(/(22+fLL4,j)w+  2  (Bv  +  iiLBu)h„ 

/-i 

w(0)«  Lx0+ Zq,  w(/)-*0  as  r-»oo  (B7) 

0-  *,A  +  S;,g,  +  By<h  (B8) 

'  2 

- g, ■  Kt  2  «,A  +  AfMa+(^l,^ 

i-1 

+  /i(i4 +  /4  j,  /*,  +  C/,  C„)  Afw 

+  ^ ,  g,  + /<  i ,  q,  +  C/,  C,2(  /  -  ) 15 

+  /•'[  + 

+  R^hj  +  Bljg,  +  B^],  g,(0— 0  as  t-*oo 

(B9) 

•  2 

-Wy-fi/*  2  AA  +  ^O^n+^ii)*5 

I- 1 

+  /iM'i2^  +  ^  +  QC<l)A/w 
+  ^  ;2  g,  +  /( 'nq,  +  QCl2(  /  -  pLM )  w, 

q,(i)-*0  as  r-*oo.  (BIO) 

Let  us  investigate  first  the  set  of  algebraic  equations  (B2) 
and  (B4)-(B6). 

Setting  |i»  0,  it  can  be  easily  shown  that  kt(Q)  and  5,(0) 
satisfy  equations  (26),  (27)  replacing  Ku  and  Fu,  respec¬ 
tively.  Then  Assumption  3  implies  that 

**«>)-**,  F,(0)-Fu.  (Bll) 

We  also  obtain  that 

/»,(0)-  -  A'£  '[A'^  +  Cl2C,0+  C’a(DuFa  +  Ay/),)]. 

i+j  (B12) 

L(0)-A2i,|/l21+  2  B^)-  (BI3) 

Equation  (B2)  and  (B4)-(B6)  can  be  interpreted  as 

v{K,v)-0  (B14) 

where  K»(Kt,K2,Pt.P2.Ft,F2,L).  Evaluating  the  Frechet 


differential  of  *  at  (AT(0),0)  with  increment  6K  we  get  the 
following  set  of  linear  equations  in  6K„  6Ft: 

%,  -(Ru  +  D'UDU)6F,  +  D^jSFj  +  B&6Kt,  i+j 

(B15) 

*3L ■  6Xy(i4j+  flj/j,  +  B(y/J,)  +  (i4j+  ByFj,)  &Kt 
+(CV>u  +  Kl,B0l  +  Fj’D;JDu)SFt 
+  [  QAy  +  +  F^RU  +  Ay  Ay)  ]  **) 

+  */y[(*iy  + AyAy)^, 

+  D!JDuFtt  +  AyAo]  (B16) 

where  <3La  and  ^  are  some  known  quantities.  The  incre¬ 
ments  SPit  SL  are  obtained  as  linear  functions  of  &Kt,  6/]. 
If  (B13),  (B16)  have  a  unique  solution  (&Kx,&K2,BFl,iFd. 
then  using  the  implicit  function  theorem  we  get  the  follow¬ 
ing  result. 

Lemma  Bl:  If  Assumption  3  is  satisfied,  and  if  (BIS), 
(B16)  have  a  unique  solution,  then  there  exists  m*  >0  such 
that  for  every  fi€  (0,^*1,  (B2)  and  (B4)-(B6)  possess  a 
unique  solution  such  that 

Xi-Ay.+OU),  F^Fu+0(n), 

/»-/>,(0)  +  0(m).  L-L(  0)+0U).  (B17) 

One  way  to  check  the  existence  of  a  unique  solution  of  the 
matrix  equation  (B15),  (B16)  is  to  rewrite  it  in  lexico¬ 
graphic  notation  as  a  vector  equation,  using  the 
Kronecker  product,  and  check  that  the  corresponding 
matrix  is  nonsingular. 

Now  we  turn  to  investigating  the  equations  for  g,,  q,, 
and  h(,  (B7)-(B  10).  Using  (B8)  we  eliminate  h,  to  obtain  a 
homogeneous  two-point  boundary  value  problem.  We  use 
a  transformation  similar  to  (A5).  (A6)  to  separate  the  slow 
and  fast  parts.  Based  on  Assumption  6  we  get  that  the 
slow  variables  satisfy 

-\V]  ]m(w+0(n  ))  V'  ,  t*y(/M)as/-oo. 

L  ®2  J  V1  . 

(B18) 

while  the  fast  variables  satisfy  the  equation 
SP  ")  [  <Pi  ‘ 

p  'j'f  m(D  +  0(p))  .  <p(0)-q>g,  <p(r)-*0. 

.  *2  L  ** . 

and  ♦,(/) -*0  as  r-*oo.  (B19) 

Assumption  4  implies  that,  for  sufficiently  small  p.  the 
unique  solution  of  (B18)  is 

v,(/)&0 .  V/>0.  (B20) 

while  Assumptions  5  and  6  imply  that,  for  sufficiently 
small  ft,  there  exists  a  unique  exponentially  decaying 
solution  of  (B19)  which  satisfies 
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9(0 -*«•(*) +<K,i),  0  (B2I) 

*,(0-\?l(*)+0(m).  V7>  0.  (B22) 

Using  the  inverse  transformation  completes  the  proof  of 
the  following  lemma. 

Lemma  B2:  Under  Assumptions  4-6  there  exists  n*  >  0 
such  that  for  every  (B7)-(B10)  possess  a  unique 

exponentially  decaying  solution.  Moreover,  for  all  /  >  0 


g,(f)-0(/i) 

(B23) 

<*K,)“*/OL(T)+o(  m) 

(B24) 

*(0-^l(t)+ <Km). 

(B25) 

Using  Lemmas  B1  and  B2  we  obtain  Theorem  3  whose 
proof  is  straightforward  using  the  inverse  of  transforma- 

tion  (Bl). 
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I.  Introduction 

Stackelberg  strategies  have  bam  defined  for  sequential  decuion- 
making  problem  in  which  one  daemon  maker,  called  (he  leader, 
announces  his  strategy  before  the  second  decision  maker,  called  the 
follower,  selects  his  own  strategy.  The  leader  anticipates  an  optimal 
reaction  on  the  pan  of  the  follower  and  determines  his  own  optimal 
Stackelberg  strategy  by  solving  a  nondassical  control  problem  that  takes 
into  account  the  reaction  of  the  follower.  Consideration  of  Stadcelbcrg 
solutions  of  differential  games  (!]— {3]  has  led  to  three  different  types  of 
Stackelberg  strategies:  I)  open-loop  strategies,  2)  closed-loop  strategies, 
and  3)  equilibrium  strategies.  Closed-loop  strategies  for  linear  quadratic 
games  are  studied  in  (4J.  It  is  shown  there  that  if  the  initial  conditions  of 
the  state  are  randomized  and  the  performance  criteria  are  averaged  over 
the  initial  conditions,  then  there  is  an  optimal  pair  of  Stackelberg 
strategies  that  are  linear  in  the  state  and  necessary  conditions  char¬ 
acterising  these  strategies  are  derived. 

In  this  paper  we  consider  closed-loop  Stackelberg  strategies  for  linear 
quadratic  games  when  the  system  in  singularly  perturbed,  that  is,  when 
the  system  contains  slow  and  fast  modes.  Investigation  of  singular 
perturbations  of  differential  games  have  been  initiated  in  (JJ,(6)  for  Nash 
equilibrium  strategies.  It  has  been  found  that  the  problem  of  determining 
closed-loop  Nash  strategies  by  singular  perturbation  techniques  is  gener¬ 
ally  ill-posed.  Ill-posedness  results  from  the  dependence  of  the  solution 
on  the  available  feedback  structure,  which  is  in  particular  exhibited 
through  the  fact  that  -toeed-loop  solutions  are  generally  distinct  from 
open-loop  solutions.  Well-posedness  is  achieved  only  with  specific  feed¬ 
back  structures  u  discussed  in  ($].  This  has  motivated  the  investigation 
of  closed-loop  Stackelberg  strategies  in  singularly  perturbed  systems 
since  the  sequential  decmon-malung  problem  also  exhibits  different 
open-loop  and  closed-loop  solutions.  In  Section  II  we  formulate  the 
problem  and  show  that  linear  closed-loop  strategies  is  defined  in  (4]  are 
not  appropriate  for  singularly  perturbed  systems  since  for  infinitely  fast 
modes  there  may  be  no  solution  even  though  a  solution  exists  if  the  fast 
modes  are  neglected.  In  Section  III  we  restrict  the  closed-loop  strategy  of 
the  leader  by  allowing  him  feedback  from  the  slow  variables  only,  and 
show  that  in  this  strategy  space  the  closed-loop  solution  is  well-posed.  As 
a  result  of  this  well-poacdness  the  closed-loop  strategies  are  approxi¬ 
mated  in  Section  III  by  near-optimal  strategies  which  ate  easier  to 
compute  and  do  not  require  the  knowledge  of  the  value  of  the  small 
singular  perturbation  parameter. 


II.  Proruem  Statement 

We  consider  a  singularly  perturbed  linear  tune-invariant  system 

i-d,,x  +  d,jx  +  «n«,  +  il,juj,  x(0)-xo  (>*) 

ia-d„jt  +  d2,x  +  .g„¥|  +  £i2Kj.  r(0)-r„  (lb) 


where  xeR’\tGR’i,u,eRm‘.  The  small  singular  perturbation  parame¬ 
ter  p>0  represents  small  time  constants,  inertias,  masses,  etc.  The  vector 
r  it  “fast"  since  its  derivative  i  is  of  order  1/p  which  is  large.  The  ith 
player  choose  his  strategy1  u,  from  admissible  strategy  set  U ]  to  minimise 
his  performance  criterion 


. « I  [“l  *  IT  Ci|C'1  c‘,Ca 

'  2  Jo  VM[CaC„  qfia 


+  ulRllul  +  ujRliuJ 


'/)<*• 


Ru>0,  iwj. 


(2) 


A  strategy  set  (uf.uf)  is  called  a  Stackelberg  strategy  with  Player  2  as 
leader  and  Player  1  as  follower  if  for  any  u2eU2  and  u,  £  Ux 


where 


-7i(“?(“i)-“t)"  «“A(“i.«j)  («> 


'Moms  ifeot  Sm  mbs  sywM  •  is  vsoS  (or  fee*  tbs  ooeirat  voJuoo  tad  eoamt  tom  ct 
tht  stayers. 


and 

uf-uftuj)  (5)  | 

Closed-loop  Stackelberg  strategies  for  linear  quadratic  problame  have 
been  studied  in  |4],  In  that  paper  l/,  and  V2  are  restricted  to  contain  .- 
linear  feedback  strategies  of  the  form  I 

«*i (*) 

where  /(f)*(jr'(r),r'(r)).  It  is  shown  that  optimal  gams  L,  and  L,  are  i 

dependent  on  the  initial  state  of  the  system  To  eliminate  due  J 

dependence  on  y&  the  initial  state  is  considered  to  be  randomly  distrib¬ 
uted,  so  that 


£{><>} -o.  £{y0ye}-^  (7) 

The  matrix  K0  is  a  design  parameter  which  may  be  used  by  the  leader  if 
he  has  a  priori  knowledge  of  the  initial  state  statistics.  If  no  such 
information  is  available,  the  choice 

*W  (identity)  (•) 

has  been  suggested  and  will  be  used  in  this  paper.  With  this  viewpoint 
the  performance  criterion  is  modified  as 


^(i1,iy-£{;((il>i1)),  *“1,2.  (9) 

The  leader  optimal  gain  £?  is  obtained  by  solving  the  following  set  of 
algebraic  matrix  equations: 

A'tM\  +  tf(4,  +  3f  j.S| j  +  Qi  “0 

(10a) 

A'CM2  +  VjjI(  +  Af|5j,Af,  +  UiR~nLn  +  ^ja0 

(10b) 

S  xA'e  +  ACN  |  —  5 1 1 M 2  ~  N2M2S\2  +  S2XM  1^2+ N2M  *0 

(10c) 

N-^A'e + ACS2  ■+■  /  “0 

(lOd) 

AuiyAf,  +  RnL2N2  -  B2(MtNt  +  MjNJ-O 

(10e) 

while  the  follower's  optimal  gain  £.,  is  given  by 

LfR^BiM,  (II) 

where 


A"^“3||Af|-3j2j,  SymBjRg  ^Ry Rg  'Bj. 
For  our  problem  (IX  (2)  we  have 


^ti 

QC„ 

Ci  Cia 

A  - 

ill 

da 

.  **- 

By 

.  a- 

CaC,x 

CaCa 

M 

Knowing  the  value  of  p  one  would  seek  the  solution  of  (10),  (11)  to 
obtaia  the  optimal  gains  Li,£j. 

In  practice  a  designer  usually  neglects  some  small  time-constants, 
masses,  moments  of  inertia,  and  other  parameters  whose  presence  in¬ 
creases  the  order  of  the  system.  He  therefore  bases  his  design  on  a 
reduced-order  model  formed  by  neglecting  the  fast  modes  (7].  This  is 
equivalent  to  setting  p“0  in  (IX  and  results  in  the  model 

+  +  +  x,(0)-.*o  (12a) 

+  +  + (12b) 

Assuming  that  Aa  is  nonsingular,  we  express  r,  as 

**“  £]■■*),  +  B2iu2l)  (13) 

and  substituting  it  into  (12)  and  (2X  we  obtain  a  reduced  game.  The  ith 
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1N0 


player  now  chooaes  hi*  strategy  from  admissible  strategy  set  l/tt  to 
mixumtsi 

■4“  2  f0  [ 't‘2xjC(0( 0k«u  +  O^y^+h^DiD^Uf, 

♦“e****-'- “**(*•),]<*.  f*./  0*> 

subject  to  the  reduced  system 

■*»“'<o*«  +  *oi*ii+,*«“zi.  ■»»<<>)— JEo  (1S) 

when 

Co-Ca-Ca-laU,,.  0,- iV-1.2. 

+  D^D^,  i  ej. 

A  cloeed-loop  Stackalberg  strategy  of  the  reduced  feme  (14),  (15)  is 
•ought  with  the  restriction  that  £/,,  end  (/j,  contain  linear  feedback 
strategies  of  the  form 


*tj(4,.«)--i|,*,(»).  *j,(Jc,.t)--/.2,Jt,(t)  (16) 

and  the  performance  criterion  (14)  is  modified  to 

ML^Lu)- EV^Ly^L,,)).  E{x 0)-0,  £(x»*o}-/.  (17) 

In  the  Appendix  we  give  the  equations  that  must  be  satisfied  by  the 
optimal  gains  LipL^.  Throughout  this  paper  we  assume  that  these 
equations  possess  a  unique  stabilising  solution. 

In  this  paper  we  analyze  the  asymptotic  behavior  of  the  solution 
£t(pX  f-i(p)  of  (10),  (II)  as  p-dX  Of  particular  interest  is  whether  the 
limit  Km,  fr/mlim,  ^trAf,  exists,  and  if  it  exists  does  it  equal  to 
j  vtMJ  If  lun^  the  singularly  perturbed  doeed-loop 

Stackalberg  problem  is  said  to  be  well-posed  since  sssumhig  p  to  be 
small,  and  neglecting  it  altogether  results  in  small  error  in  the  design 
procedure.  An  example  of  a  weil-poeod  design  problem  it  the  optimal 
control  problem  [8),  while  an  example  of  an  ill  posed  problem  it  the 
doeed-loop  solution  of  the  Nash  equilibrium  strategy  [5)  Investigation 
of  the  iU-poeedneas  of  Nash  games  (6]  shows  that  the  cause  of  ill-posed- 
nets  sstme  from  the  difference  in  the  information  structures  of  the 
limiting  full  problem  at  p—0  and  the  reduced  problem  (or  j»«Q.  Nash 
games  have  the  property  that  the  solution  depends  on  the  information 
available  to  the  players  (e.^.  they  in  general  have  different  open-loop 
and  doeed-loop  solutions).  Allowing  the  strategy  in  the  original  game  to 
be  a  function  of  the  full  state  means  that  the  solution  depends  on 
feedback  information  on  the  fast  modes  t  of  the  system.  This  informa¬ 
tion  is  not  available  in  the  reduced  game.  Thus,  the  doeed-loop  solution 
of  •  Nash  game  does  not  tend,  in  general,  to  the  doeed-loop  solution  of 
its  reduced  game.  In  consistency  with  this  argument  it  is  shown  in  (6| 
that  if  ere  solve  a  full  Nash  game  assuming  only  x  is  available  for 
measurement,  the  solution  as  j»—0  tends  to  the  doeed-loop  solution  of 
the  reduced  Nash  game.  In  the  optimal  control  problem  it  turns  out  that 
allowing  the  control  in  the  full  solution  to  also  be  •  function  of  r  is  not 
crucial  for  this  limiting  behavior  and  the  problem  is  well- posed.  This  is  a 
consequence  of  the  fact  that  for  the  optimal  control  problem  the  open- 
loop  and  the  doeed-loop  solutions  lead  to  identical  controls,  trajectories, 
and  cost  functions.  The  above  conclusions  concerning  the  relation  be¬ 
tween  the  information  structure  end  the  weU-poeednees  of  singularly 
perturbed  problems  bold  for  any  problem  in  which  the  open-loop  end 
doeed-loop  solution*  are  different.  Since  Stackalberg  strategies  have 
different  open-loop  and  doeed-loop  solution*  [3]  ate  expect  that  seeking 
a  solution  of  the  full  game  in  the  form  (6)  might  lead  to  an  ill-posed 
problem.  Analyzing  the  asymptotic  behavior  of  (10)  shows  that  the 
difficulty  with  solutions  of  the  form  (6)  is  more  serious  than  having  a 
limit  which  is  different  from  the  reduced  solution.  In  fact  (10)  may  have 
no  solution  in  the  limit  as  p-*0  even  if  the  reduced  game  ha*  t  solution. 
To  see  this  node*  that  irises  k,2-0  for  (10)  to  have  a  unique  solution  it 
is  naemsary  that  the  matrix  N2  be  positive  definite  (nonemguler)  a*  it  is 


obvious  from  (10*).  In  our  earn  Nj  Made  to  a  riagular  matrix  as  p-riX 
The  reason  is  that  as  p-*%  i{t)-Kx{t)  for  all  />0  whsr*  K  is  soma 
constant  matrix,  whils  /f£(>(»b''(»))4k.  Thus,  it  can  b*  emiy 
shown  that  Af2  has  rank  a,  as  p-sO.  To  munrata  this  fact  ooneider  ths 
following  example 
Exmf/i: 


*.-*»- 


£a-l, 


*it“*ti*«. 


]• 


d«) 


W*  seek  the  solution  of  (10)  in  the  form 

JUS]’  *'“[!£  a£]>  <w> 

when  the  form  of  hi,  it  chosen  to  avoid  unboundadam*  in  the  limit  at 
p-s0,  u  usual  in  singularly  perturbed  Riccth  equations  [8],  Setting  p -0 
in  (10)  we  obtain  the  limit  value* 


'"n“»«uO  +  *a).  "ii" Vl+(l  +  4)*  — (1  fjs).  «u"0 


-*--*!+/»)+-*  V7^?  ~ f«fa, 
_ 1±jL  f& 

(l+/?,)-c% 

’  "u“a ,,c 

1  1  o 

*11“  “  2c  ’  "a",~2’  "°"~2 


l  +  /u 


(20a) 


(Mb) 


(20c) 


(20d) 


1  »  ,  ,  .  1  .  1 

w  ,»—,+2^+ssrl  <»•> 


(21) 


Node*  first  from  (20d)  that  Af2  is  singular.  This  means  that  ths  existence 
of  a  solution  depends  on  whether  (10s)  is  consistent  or  not  In  this 
particular  example  it  turn*  out  that  than  is  no  solution  as  we  can  sss  by 
eliminating  between  the  two  equations  of  (20s)  and  substituting  (21) 
for  c  to  get 


V  14.(1  + w*  -(l  +  /«)-0  (22) 

which  is  satisfied  only  if  /2l-»oo.  On  the  other  hand,  the  reduced 
problem  is  given  by 

4 o *  —  1,  *oi  “  *oa“  1.  C|0-Cw-1,  Dym0*  ™  1. 2  (23) 

end  Che  corresponding  equations  (AI)-(A5)  have  e  unique  solution 

0.25992.  W,,- 0.3486,  Af^- 0.33 184  (24) 

Thus,  we  have  a  situation  in  which  the  reduced  problem  has  a  unique 
solution  whils  the  full  problem  has  no  solution  in  the  limit  as  p—O.  Thu*, 
based  on  the  discussion  of  ths  information  structures  and  of  the  possibil¬ 
ity  of  having  ill-behaved  limits  as  p-»0.  we  reach  the  conclusion  that  the 
set  of  strategies  defined  by  (6)  is  not  the  appropriate  set  to  obtain 
closed-loop  Stackalberg  strategies  for  singularly  perturbed  systems. 

Our  task  now  is  to  choose  new  strategy  sets  {/,  sad  U1  for  the  solution 
of  the  singularly  perturbed  Stackalberg  game.  Our  choice  ta  guided  by 
the  utility  and  simplicity  of  linear  feedback  strategies  and  tbs  above 
eoncluawns  on  the  relation  of  well  poaadness  and  information  structure. 
To  this  and  we  discuss  the  effect  of  allowing  ths  piayen  to  know  the 
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currant  value  a f 1.  Km  we  diacrimiaats  between  tb*  Is edsr  tad  the 
follower  aa  a  molt  of  (1m  diftoam  roUa  they  have  in  (ha  plum.  Tha 
follower  aunty  aotvaa  aa  optimal  ooaooi  problem.  ao  if  (ha  laadar 
strategy  aat  ia  wall  defined.  (ha  follower  may  ha  allowed  to  uaa  tha 
carnal  valaa  of  z  without  affecting  (ha  waU-poaarto*ti  of  (ha  resulting 
optimal  ooadol  problem.  Thus,  (ha  follower  strategy  aat  Ux  aaad  aot  ba 
modified  aad  will  continue  to  ba  dafiaad  by  (6).  Tha  laadar,  however, 
aoivee  a  control  problem  which  haa  different  open-loop  aad  cloaad  loop 
solutions.  Thus,  to  have  tha  problem  wail-poaed  we  exclude  from  hie 
information  aat  tha  kaowiedfe  of  tha  current  value  of  x  aad  hia  strategy 
aat  l/J  will  now  ba  dafiaad  by 

u^x.r)--i2la(r).  (25) 

Thia  choice  of  the  UJ  guarantee*  that  the  full  game  solution  involve*,  ia 
the  hunt  aa  fa— >Qi  the  same  information  available  ia  th«  reduced  problem. 
It  win  be  (hown  that  thia  choice  overcome*  the  ill-po*ednea  of  the 
pcobtem  end  in  overcome*  problem*  relating  to  the  singularity 

of*,  .use*  only  the  positive  definite  part  of  *,  will  be  used. 


III.  Constrains)  Cumid-Loof  Stacks  aamo  Stratboy 

la  thi*  section  we  analyze  the  atymptotic  behavior  of  linear  Stack el- 
berg  strategM*  when  the  leader  is  restricted  to  take  feedback  from  tha 
slow  variable*  only,  aad  thus  when  £,  is  restricted  to  have  the  form 
£,“(£,1.0).  We  will  refer  to  this  solution  as  a  constrained  Stacfceiberg 
strategy. 

By  employing  the  matrix  minimum  principle  [9]  to  derive  the  neces¬ 
sary  conditions  for  this  problem  we  find  that  the  leader  optimal  gain 
is  obtained  by  solving  (lOeHlOd)  together  with 


IV.  Niak-Oftmal  Stratsoy 

The  weH-posadnets  property  will  now  be  used  to  obtain  a  near-optimal 
strategy  for  the  constrained  Stacfceiberg  game  which  is  eerier  to  compute 
as  oompared  to  the  exact  strategy.  Motivation  for  this  it  that  g<» 
tha  constrained  Stacfceiberg  strategy  it  wall  behaved  as  p—O,  solving 
(lOaMlOd)  aad  (2d)  may  aot  be  easy  because  of  the  high  order  of  the 
system  or  because  of  the  numerical  difficulties  arising  ia  solving  the 
Riccati  aquation  (10a)  when  ft  is  very  small.  Theat  reasons  motivate, 
while  the  results  of  Section  III  on  the  limiting  behavior  of  tha  con¬ 
strained  strategy  as  p—0,  allow  the  construction  of  aa  appropriate 
approximate  strategy  which  is  easier  to  compute  than  tha  exact  full 
solution  la  this  section  am  postulate  such  aa  approximate  strategy  which 
takes  into  account  the  slow  sad  fast  modes  of  the  system.  We  then 
axplein  ia  what  sense  this  strategy  is  near-optimal. 

Suppose  that  the  players  solve  the  reduced  order  Stacfceiberg  game 
(H).  OS),  (17)  for  the  slow  modes  of  the  system  aad  their  optimal  gains 
are  Suppose  also  that  the  follower  solves  the  following  optimisa¬ 

tion  problem  for  the  fast  modes  of  the  system:  find  nv  to 

A/“  j  f0  (*/ci)CiJ*/+u'i/*ii“i/)rfr-  tm  ~  (30) 

subject  to 

dr. 

-£»Aj2Zf  +  Bixux/.  (31) 

Assuming  that  (Ab.BjlCu)  is  stabilixaMe-detactable,  the  solution  of 
this  optimisation  problem  is 

*»!/■  "  R|7  'fJiHi/t/  (32) 


31|jfn*n  +  *22^11*11 -  *12(^11*11 +  3f,,*,|)-  +  Mytix) 

-  fJ,-J(M1j*;i  +  Af n.vy  -  By,  M  -  0  (26) 

where  M„  N„  L,  have  been  partitioned  as 


Af|, 

.  V,- 

"n 

"a 

(•Afa 

Na 

V 

0). 


(27) 


irhers  Mx,  is  the  unique  positive  setmdefimte  solution  of  the  Riccati 
equation 


Af  i/d  a + dJ,Af  1/+  Ci',C|,  —  M  vij|  R  |7  'Bji  A#v—0.  (33) 

Tha  follower  then  composes  his  approximate  strategy  as  the  sum  of  his 
Slow  strategy  ifi,-  -  Lux,  and  his  fast  strategy  »,/«• 

He  replaces  Zj  by  z-z,,  where  from  (3) 

Then,  replacing  x,  by  x,  he  usee  the  approximate  strategy 


Without  any  loss  of  generality  the  matrices  M,  are  assumed  <0  have  the 
form  (27)  ia  order  to  obtain  a  set  of  well  defined  equations  ia  partitioned 
form,  as  p—0.  The  reUtion  between  (26)  sad  (10s)  becomes  evident  if  we 
write  £,  ia  (10c)  as  £,—(£,  1 aad  partition  (lOe)  into  two  equation*. 
The  first  corresponds  to  taking  the  partial  derivative  of  tbs  criterion  with 
respect  to  £jt  the  second  with  respect  to  L&.  The  first  equation  for  the 
earn  now  considered,  when  Lum0,  reduces  to  (26),  while  the  second 
equation  does  aot  appear  because  Lp.  is  constrained  to  be  zero.  We  not* 
that  the  follower  strategy  is  still  given  by  (II). 

We  now  investigate  (IDaHlOd)  aad  (26)  as  p—0.  Assuming  that  the 
triple  (da,£j1,Cu)  is  stabilizabio-detectable,  it  can  be  shown,2  after 
lengthy  manipulation,  that  f*,(0),  «,,(0),  M„( 0),  *,,(0),  aad  V„(0) 
satisfy  (A1MA5)  replacing  £*,  Mu,  *„,  aad  respectively. 

Assuming  that  (A1)-(A5)  possew  a  unique  stabilizing  solution  we  get 
that 

2-n(0)  ■  I*.  Afn(0)w  MXv  Afji(0)-Af^, 

*n(0)-*,„  *„(0)-*fc.  () 

Subsequently, 

£*}-i«rAf.-/..  1-1.2.  (29) 

Thus,  the  eonstrained  doeed-loop  solution  of  the  Stacks! berg  guns 
(I).  (2),  (9),  (25)  is  well  posed  ia  the  lease  that  it  tends  to  the  closed  loop 
eolation  of  tha  reduced-order  Stacfcriberg  game  (14),  (15),  (17)  u  p—0. 


"Ues1*  ~  2-ijA  —  R,7  'B}|Af|/{r  +  /ITj'Mji  —  B*\L.U  -  BnLla)x] 

*f)[pAfW0)  pAfv][Jl 

4  -R,7  'BiKxy.  (34) 

Tha  leader  continues  to  use  bis  slow  strategy  replacing  only  x,  by  x  so 
that 

*!*,<■ -£*■*--(£*  0)y~-Fxy.  (35) 

We  now  investigate  tbs  effect  of  using  the  approximate  strategies  ulafr 
Uuty  instead  of  the  exact  constrained  strategias  «*«•£,/,  11J  -  L^y  - 
L,,x.  Since  ia  a  Stacfceiberg  strategy  tha  leader  announces  hit  strategy 
first  it  must  be  shown  that  the  approximate  strategy  XJ  is  near  optimal 
from  the  I  seder’s  point  of  view.  This  mesas  that  if  the  leader  uses  u.irr 
aad  the  follower  straiegy  lies  on  the  reaction  curve,  tie,  u, - 
then  the  leader’s  performance  criterion  tends  to 

U*T.*i)  ss  p— 0.  Next,  if  the  leader  uses  and  the  follower  uses 
the  approximate  strategy  «layr  then  must  be  near  optimal  from  the 
follower's  point  of  view,1  i.e.,  the  follower’s  performance  criterion 
A(“imr“*«F p)  tsntis  to  /|(sf!»i^),«i^f)  u  p-*0-  It  is.  however,  noted 
that  by  using  tbs  approximate  strategy  uttw  the  follower  deviates  from 
tb*  reaction  curve  u,  ■  uj^u,),  sad,  strictly  speaking,  violates  the  rules  of 
tbs  game.  Such  deviation  from  the  reaction  curve,  i.e^  from  the  strict 

ly  WmBw  mm m  aoMag  for 
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definition  of  the  solution.  will  be  tolerated  in  computing  the  approximate 
solution.  just  as  it  is  in  optimal  control  problems  (8),  or  Nash  fames 
(31[<L  if  the  reeultinf  effect  of  the  deviation  on  the  leader's  value 
function  from  the  me  Stackeiberf  value  remains  small.  In  other  words, 
the  use  of  the  approximate  strategy  u)vr  by  the  follower  will  be  tolerated 
it  tends  to/^u?(<*j^),ui^)  as  n— 0. 

The  near  optimality  of  the  approximate  stratefy  is  estab¬ 

lished  in  the  following  theorem. 

Theorem.'  If  (A1MA5)  possess  a  unique  stabilizing  solution  and  if 
(da,  is  stabilizable-detectable.  then 

hm  -0  (M> 

H®  [/|(sw«iw)-/iW«iw).»iw)]*0  (J7> 

h®  [/j(«lwr“JMe)-/t(“f(“nw)."»w»)]“0-  (3#) 

Moreover, 


Seeking  If;  in  the  form  (43)  and  subtracting  (41)  from  (46)  and  (42)  from 
(47),  it  can  be  shown  that 

W/O)- K/0).  «- 1.2.  >-1.2.3  (4g) 

which  proves  (37)  and  (38).  The  proof  of  (39)  is  now  straightforward. 

V.  Conclusions 

We  have  shown  that  allowing  the  leader  to  use  feedback  from  t  stay 
result  in  the  full  problem  having  no  solution  for  sufficiently  small  p,  even 
though  the  reduced  problem  at  p-0  has  a  solution.  We  avoided  this 
difficulty  by  excluding  i  from  the  information  available  to  the  leader. 
This  information  structure  is  reasonable  when  the  stale  vector  x  is 
available  for  measurement.  However,  in  many  physical  systems  one  has 
no  access  to  the  state  vector  x  sad  can  only  measure  some  linear 
combinations  of  x  and  For  such  cases  alternative  ways  of  overcoming 
the  ill-poaedaats  of  the  problem  when  output  feedback  rather  than  state 
feedback  is  available  must  be  explored. 


Km  I*0,  <“1.2.  (39) 

Proof:  When  the  exact  constrained  strategies  uf  -  - Lty,  u$“- 
Lj/--(Lj,  0)y  are  used,  the  resulting  values  of  the  performance 
criteria  are  y,(uf.uj)- \ t iM,  where  Af,  and  Af2  are  given  by  (10a)  and 
(10b),  respectively.  Suppose  now  that  the  leader  uses  the  approximate 
strategy  -  -  F2y,  and  let  the  foUower  respond  optimally  by  using 

where  K,  is  the  stabilizing  solution  of  the  Riccad  equation 
K,(d  -  Su  r,  -  BjFJ-KA  -  S„  V,  -  B2FJV, 

+  Oi  +  y,SnV,  + 

Tbs  resulting  values  of  the  performance  criteria  are  /,(«?( «icfe).uMer) 
a  K„  lm  1,2,  where  K,  satisfies  (41)  and  V2  sa defies  the  equation 


(40) 


(41) 


y*A  -  s„  y, -SjFJHA  -  s„  K,  -  B2FJ  V2 


+  Cl  +  y,  +  F2XuF2-0.  (42) 


We  seek  V,  and  V2  in  the  form 


K- 


K, 

Wa 


*ya 

*ya 


1-1,2. 


(43) 


Substituting  (43)  in  (41),  setting  p~ 0,  using  that  the  matrix  (Au- 
BJIBn  'B2 tMv)  is  subie  and  that  (A1)-(A5)  possess  a  unique  stabilizing 
solution  it  can  be  shown  that 

y- 1.2.3.  (44) 

Using  (44t  we  can  now  prove  (36).  To  do  this  we  substitute  (43)  in  (42), 
subtract  (10b)  from  (42),  set  jt-0,  use  (44)  and  employ  the  stability  of 
the  matrices  A,  and  (da-  B^B^  ‘•®ai  M,/).  It  follows  that 

^V<0)-wv(0).  y-'-2-3  (45) 

which  proves  (36).  If,  instead  of  rseponding  optimally,  the  follower  uses 
the  approximate  strategy  ul<w-  -  Jt,V*i*i.y.  the  values  of  the  perfor¬ 
mance  criteria  will  be  J,(u llw,ej^)“  j  tr  Wt,  where  Wx  and  W2  satisfy 

the  equations 


W,(A  -  5UX,  -  B2Ft)HA  -  S„K,  -  B2F2)‘  W,  +  fi, 


+  x;s„x,  +  Fi*l2F2-0  (46) 
W,( A  -  S, | K,  -  B2F2) HA-SuK,-B2F2yW2  +  Q2 

+Kis2lK,+r2KnF2-o.  (47) 


Amoa 

The  set  of  necessary  conditions  that  the  solution  of  the  reduced 
Stackelbcrg  game  (14),  (15),  (17)  must  satisfy  are  derived  by  employing 
the  matrix  minimum  principle  (9J.  The  leader  optimal  gain  £*  is  ob¬ 
tained  by  solving  the  following  set  of  algebraic  equations: 

M  lrA,  *  A‘,M  tJ  +  C;0C,0- CJof),  |it|o  'D\ ,  Cm 

-  CUf- DltX{o  '^iiJ^itAa  “ 

+  fi(8|io"0|i^ii8|Jlfli,|llii)ij,  +  lfb8i|8|cll||l/|1,,0  (Al) 

Mfed, + AJKj,  +  Cy)C2 o  -  io'OJiCio- CloDu  8  io  '^zi 

♦  C,'of>i  iff,;  ‘RjioRm  ’Di',  C,0 + (  -  C’i»/>j2+ Cmf>], A, g'f), ',/>]} 

—  C|'ef>nB|J  'B2l0R  |g  lHi|D1]+CjllD||8||ll)]|l>a)t|l 

■f  Vu(  -  D\2Du  A^'TJ^Cjo- 

—  (  CjnDji  -  Ciof>i|!t|g  ‘B2h>)Bio  %\K. 

—  M \,B<)i  B  !0  l(f7ji  -  AjigA  t3  ‘-On  C|0) 

+  I?*(^22^}i —  8>i*f>nB|o  'RjioJff.o  i, 

+  A/,.**** 'Ww'Bi,  A/,,-0  (A2) 

.V  lr^'  +  A,N  g  —  J(|2|5  —  Afj,Af j,B0i^io  '^oi 

-  B0|flI3,(Z)2|Cj0-  BjKsAio’OliCioJAfj, 

-  AfliCCjgDji  —  Cjgf>||R |0lJtjIp)fl|0l*0l 

+  BS|A,3  'Ajig/lio  'a^M^ 

+  NUM  ijB0|A|3  'BjigKio  'fl»i 

-  NMD‘l2DuR{i  'Rj,0- 

-  ^os^io,(^tio^iol^!i2>ii“  (A3) 

+  +  (A4) 

(^i»“ 

-  f)  j  jf>  1 1 B  to 'Uj  i  f)a)  ^i>  ^  ir(  ^  —  i  ^  io i )  ^io8f  t# 

-(fJuCjo-DJjDiiAij'OjiCm+OJjfJnAii'Bno^io'^iiCio 

-  D^D^B ,3  |9) -  (Bos  -  «o.^ii  l®ii®n),(8f|i^i»  +  ^i>^») 

-(X>,'a/>„Jb,3,ft«o- OzsOi.)^.;'^.^..^-*)  (^5) 
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AMTRACT  This  paper  is  concerned  with  a  linear  closed-loop  Stackelberg  strategy  for 
singulaity  perturbed  systems.  A  procedure  to  obtain  a  well-posed  formulation  of  the 
problem,  where  both  fast  and  slow  modes  are  available  for  measurements,  is  given. 


L  Introduction 

The  Stackelberg  strategy  (1-3)  is  the  solution  concept  for  a  broad  class  of 
decision  making  problems  in  which  one  decision-maker,  called  the  leader, 
announces  his  strategy  before  the  other  decision-maker,  called  the  follower, 
selects  his  strategy.  There  are  different  types  of  Stackelberg  strategies:  (a) 
open-loop  strategies,  (b)  closed-loop  strategies,  (c)  feedback  strategies.  For 
more  information  about  these  types  die  reader  is  referred  to  (11,  13).  The 
closed-loop  Stackelberg  strategy  appears  more  favorable  to  the  leader  than  the 
other  two  kinds  (4,  5),  but  the  disadvantage  ia  using  the  closed-loop  Stackel¬ 
berg  strategy  is  that  it  does  not  satisfy  the  principle  of  optimality  (4). 

When  the  space  of  closed-loop  Stackelberg  strategies  is  constrained  to  be  a 
linear  function  of  the  state  variables,  it  was  found  (6)  that  such  linear  strategies 
do  not  exist  because  some  gain  matrices  depend  on  the  initial  conditions.  But 
by  assuming  that  the  initial  conditions  are  randomly  distributed  and  averaging 
the  performance  indices  over  these  initial  conditions,  linear  closed-loop  Stac¬ 
kelberg  strategies  were  obtained. 

When  the  system  contains  slow  and  fast  modes  the  control  problem  is 
numerically  stiff.  To  alleviate  this  numerical  stiffness  and  to  decrease  computa¬ 
tional  manipulation  the  singular  perturbation  method  has  been  used  (7). 

Applying  the  theory  of  differential  games  to  singularly  perturbed  systems 
was  initiated  in  (8,  9),  in  which  it  was  found  that  the  usual  formulation  using 
singular  perturbation  techniques  to  find  closed-loop  Nash  and  Stackelberg 
strategies  is  generally  ill-posed.  In  (8)  a  method  was  shown  to  obtain  a 
well-posed  formulation  for  Nash  games,  when  both  the  slow  and  the  fast 

7  This  work  was  supported  in  pan  by  the  National  Science  Foundation  under  Grant 
ENG  74-20091,  in  part  by  the  Joint  Services  Electronics  Program  under  Contract 
DAAG-29-7S-C-0016  and  in  part  by  the  U.S.  Department  of  Energy,  Electric  Energy 
Systems  Division  under  Contract  EX-76-C-01-2088. 
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variables  are  available  for  measurements.  In  (9)  a  linear  closed-loop  Stackel- 
berg  strategy  as  described  in  (45),  was  considered  and  it  was  shown  that  if  we 
restrict  the  space  of  strategies  to  be  taken  from  the  slow  variable  only,  we 
obtain  a  well-posed  formulation. 

In  this  paper,  we  consider  the  linear  closed-loop  Stackeiberg  strategy  when 
both  the  slow  and  the  fast  variables  are  available  for  measurements.  This 
information  structure  is  different  from  the  one  in  (9).  We  describe  a  method  by 
which  we  find  strategies  using  reduced  order  systems  such  that  if  we  apply 
these  strategies  to  the  full  order  system,  the  resulting  cost  functions  will  have 
the  same  limits  as  the  cost  functions  for  the  same  full  order  systems  if  the  full 
order  optimal  strategies  are  applied. 


IL  Formulation  of  the  Problem 
Let  us  consider  the  singularly  perturbed  system: 


*  -  Aux  +  A12z  +■  B: iUt  +  Bl2u2;  jc(0)  *  Xo, 

Mi  *  A2j*  +A22*  +  B21u,  +  Bj2u2;  z(0) -Zo, 

where  xeR\  rsR“>;  u,  s  R“>  and  n  is  a  small  positive  parameter.  Assume 
that  the  cost  function  associated  with  player  i  is 

l  -  E[i£  {y'Qy  +  uf^+ufRy^ldrj, 

where 


y- 


Qu] 

Qj 


Ru,  Ry  are  symmetric,  positive  definite  matrices,  E(y0)  **  0;  E( yuyj)  *  I  where  f 
is  the  identity  matrix. 

A  strategy  set  (u*.  uj)  is  called  a  Stackeiberg  strategy  with  player  2  as  a 
leader  and  player  1  as  follower  if  for  any  u,  €  Uu  u2  €  •v2. 

uJ)s/2(Tu2,  Uj), 

where 

JtITWt,  Wj3£jx(uu  Uj) 
and 

u*-TuJ. 


Closed-loop  linear  Stackeiberg  strategy  was  considered  by  Medanic  (6).  In  his 
paper  the  controls  were  assumed  to  be  of  the  form 

Uj»-F,y,  Ut  •-Fty 

and  F2,  the  gain  of  the  leader  is  found  by  solving  the  following  equations. 


AJM,  +  MiAc  +  F2R,2F2-(-Ql  *0. 


(la) 


A,Mj+  M2  Ac  +  WlS2iMl  +  Fjf?22F2  +  Q,  =*  0, 


(lb) 
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tVtA'c  +  AJft-Su\{2N2-V2M2Sii+S2lMxN2+N2MlS2i-0,  (lc) 

N2A't + A*N2 +  /  ■  0,  (Id) 

R  l2F2Sx  +  RaFjN,  -  B2(MXNX  +  M,Nj)  -  0,  ( le) 

where 


Ft-JtfB’tMu 

Af  m  A —S\iM\  “BjFi, 

S\f  “  Bjily 'RjfjRy  *B/, 


In  general  by  letting  -*  0  in  the  full  order  system  we  change  the  meaning  of 
the  vector  z  from  a  state  variable  to  a  variable  which  depends  on  x.  So  if  we  solve 
Che  resulting  slow  optimization  problem,  we  will  have  a  change  in 
information  structure.  To  avoid  this  change  in  information  structure,  we  solve 
the  problem  as  an  output  feedback  problem,  where  we  constrain  the  feedback 
to  be  taken  from  x  and  z.  This  is  dearly  shown  in  Section  IV. 

In  the  following  sections  we  will  show  a  procedure  to  get  a  well-posed 
solution  of  the  problem  depending  on  reduced  order  systems  while  both  x  and 
z  are  available  for  measurements  for  both  players.  Let 

“u*«  ~ i<ii*  “  ^u2* 

**!•»  "  """L^iX  LqZ. 

The  follower  will  find  Ll2  by  minimizing  the  fast  part  of  his  optimization 
function  while  the  fast  pan  of  the  system  is  given  and  he  will  And  Lu  by 
minimizing  his  modified  slow  optimization  function.  The  leader  will  find  his 
gains  L2i  and  L~,  by  minimizing  his  slow  pan  of  the  optimization  function 
under  the  constraints  that  the  follower  applies  the  above  procedure  and  the 
slow  pan  of  the  system  is  given. 


US.  The  Fast  Optimisation  Problem  for  the  Follower 

The  follower  can  find  the  gain  Ll2  by  minimizing  the  fast  pan  of  his 
performance  index  which  is 

J\tm  (zfOtjZf  +,UtfRiiUir  +  uirF|2u2f)dtj, 

given  that 

*  A22zf  +  Bj,  utf  +  B&Uy 

v<*  ooo.  so.  o.  vtoMk  trrs 

Fnn— ri  in  Noctfmrw  IfttaMl 


z,  *  ~ (Aja ~  l3 - l(Aj| -B?lX.u  —  B^L^x,. 

Assuming  that  (A.n- BnLxi- B-nLn)  is  non-singular  and  substituting  for 
u,„  u^,  z,  in  the  differential  equation,  we  obtain 

*,  *[AU  ~  Bl2LiX  ~(Atj-BnLij-SijLx2)(A32  — BuLt-  — 

"*  (A3>  “BjiLti“  BaLjjJJx, 

or 

i,  -  A**,,  z,(f)  -  <*(t,  0)x(0), 

where 

Ao  m  Atl  —  A,!^^  Ailt 

An  “  A,i“B||£.n“  Bl3L3„  A13  *  A13  — BuL|3“  Bl3L32, 

A3l  “  A3l  —  B3,Lu  -  BnLi„  A 22  ■  A33~  B31Li3“  ®za^-zj- 


JowtmI  of  Tht  PrMklin  Inuiwtt 
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Substituting  for  u,„  u^,  r,  in  the  optimization  function  of  the  follower,  we 
obtain 

7U  m  E  0)COu  +  E'uR\iLii+ L-nRizLu 

~  (Qut + L  i  iR  i  iLu + LjiRizLa) 

X  All  Aji”  Aji(Aja)'(OlJ  +  ^n(Aja) 

x(0\3^ LiiRiiLn+LziRi-L^Aji ^21^(1, 0)}xq dtj. 

Applying  the  same  procedure  as  in  the  output  regulator  problem  (10),  while 
using  the  assumption  that  E(xoXo)  “  I,  we  obtain 

7u(i-u,  Lit) *  J  trace  0){Oii —  OiaAjjAn  —  Aj,(Axi1)'<5u 
+ Aj^A^yOtjAii  Aji]d>(i,  0)  dt, 

where 

<5u  “  Q\i  +  L\xR  uLu+  L’nRfjLzi, 

Oi-  m  Ou+l,u^ulii+^ji^ijla> 

<3u*  Ou+f-ijJRnLia  +  LjjJluI^a. 

Finding  dJjdLn  and  putting  it  equal  to  zero  we  obtain 

Ri\Lu~  RuLuA^2  Aai  +  fl2i(Aja,)'(5'l2  — Bj^AjaVOuAj^A^j  ■  6\Klt, 

(4) 

where 

6[  •BU-BUAZYUiJ 


and  JCU  is  the  solution  of 

XuAo+ AJXu  +■  0t  1  ”  OijAja  Ajj  —  AJ^Ajj1)  Ofo 

^  Ajj(Aij)  O13A23 Aji  *  0.  (5) 
Substituting  for  Ll2  obtained  from  Eqs.  (2),  (3)  in  Eqs.  (4),  (S),  we  can  And  L„. 

Comments 

(1)  Finding  dJyJdLl2  and  letting  it  equal  to  zero  will  lead  to  the  same 
equations  as  (4),  (3).  This  is  due  to  the  fact  that  z,(t)  is  a  linear  function  of 
*,(»)• 

(2)  If  we  constrain  u,,  ■  -Lnx,  and  apply  the  same  procedure,  the  formula¬ 
tion  is  Si-posed. 
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(6) 


V.  The  Leader  Problem 

Before  describing  how  the  leader  can  find  In,  La,  it  is  advantageous  to 
change  the  form  of  Eqs.  (4)  and  (5)  by  using  Eqs.  (2)  and  (3)  and  by  letting  L„ 
to  be  of  the  following  form 

Li.-KTiHB'uKu+Bi.JC'ta). 

Then  after  some  straightforward  but  lengthy  algebra  Eq.  (4)  leads  to 
K 12*  “[0»i + L itf? la^a  +  K uBl2I^2  + 

where 

An  *  A2i  —  —  B-aL^i, 

S\2m  B\iR Bti,  5n-BuBulB'u 
and  Eq.  (S)  becomes 

Ki»Au  A'nJCit  ~  KuSuKn  —  JftiBi2L2,  —  L2iB'l2JCti  +  Qn“*  KuSjjKij 

+  JCv2A2l  +  A2ifCi2+ L2lRi2L2l  *  0. 

By  substituting  for  ulw  r,  in  the  slow  part  of  the  leader’s  optimization 
function,  we  obtain 

4  *iE^  *10ji~ OjaAnAjj  — A21(A22'y0jj 

+  AniAnO'OuAa  A21]x,(t)  drj. 


(?) 


where 

Oki- 

O21  +  L2tR22L22  +  Ki2^22^n  + 

+  JCuS2lJClx  + 

l5n  * 

Oz2  +  L  ZlRzjLji  +  l24s  Jf  13  + 

0z3  m 

Q»  +  l-riRnl-n  + 

Sti *  BuRjilJ?2iBuB'u,  Sfz m  B\\R \x RuR B'u, 

Sn*  BjjRivBjjRii  Bji. 

Let 

4  -  E  Cix'(0)/CaJc(0)]F 
.10) 

where  K2  satisfies 

AqKj  +  KjAq  +  <52j  —  OjaA^Aj!  “  AjiUm) 

+  Ajt(Ajj)  OuAjj  Aji  *0.  (8) 

So  the  leader  has  to  minimize  7U  under  the  following  constraints: 

Ajj4  +  KtJAj3  +  +  L>jR  ijLja  ^Qu*0, 

f^iiAit  + A'ufCn- Ku^uKu  —  XnB  tjL  2,  —  LiiB'^Kti  +  Ou“ 

+  /Ci2A;i  +  A2iK'i2  +  L21R(2L2i  *0, 
AJJ(2  +  KjA0+  02i —  022  A  jjAji-AjjIAjj)  022  A*  An(  A  Ojj  A22  Ah  •  0, 
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where 

Xi2m  ■"COll  +  i'2lRu^'I2+’  ^U'A|2“KuB12Ljj  + A^lfujAja1. 

The  reader  is  referred  to  Appendix  A  for  the  derivation  of  the  necessary 
conditions  for  the  leader’s  minimization  problem  . 


IV.  Full  Order  Problem 


In  Eq.  (1)  we  assume 


AC 


Mli  pMjj  _  ^  r  Nli  Nii 

#sMjj  nM3_  1  |_  N^  NtJ_ 


Substituting  for  Mt  in  Eq.  (la)  and  letting  m  -*0,  we  obtain  the  following 


AJuMu(0)+Mu(0)A,n  <t-A;„M'l.(0>+MlS(0)Ae,l +MU(0) 

X  (SuMu(0)+ 5uM'l2(0»  +  M,j(0K5',2Mu(0) 

+  5„M'l2(0)) + P2l(0)RuF21(0)  +■  Q„  -  0,  (9) 
Mu(0)--[Ou  +  Fil(0)J?uFll(0)+(AJl-512Mu(0)-B»FIlf0)),Mu(0) 

+  Mu  A  a  -  Mi  i(0)Bi2F22(0)]A(:i,  (10) 
A'caMul  0)  +  Ml2(0)Ar22 + Mu(0)$13Ml3(0)  +  Ffe(0)*uFa«»  +  Ql3  *  0, 

(ID 

where 

A.,,  -  Au-§nM„(0)-5l2M'l2(0)-B12F„(0), 

A.  l2  -  A  i2  -  $,2M„(0)  -  BuFa(0), 

A«2l  -  A2,  -  5'12M„(0)  -  SuM'12(0)  -  Bj,F2l(0). 

A« 22  *  A22~  5|jMij(0)”  B22F22(0), 
assuming  that  A* -2  is  non-singular. 

It  is  noticed  that  Eqs.  (3).  (6)  and  (7)  axe  identical  to  Eqs.  (11).  (10)  and  (9) 
respectively  where  Mu(0),  Ml2(0),  Ml3(0),  F2l(0),  F„(0)  replace  ATU,  Ku, 

A tv  L21.  I-n- 

Subs  tituring  for  Ma  in  Eq.  (lb)  and  letting  u  — *0,  we  obtain 
Mj,(0)A,  „  +  A't|M2|(0) + M»(0)A.21  +  A;22M'i2(0)+  02l  +  P^mR^F^iO) 

+  Mn(0KSjiM„(0)+5n^  (0))+Ml2(0)(5i2Mu(0)  +  S2>M'lj(0))-0,  (12) 
M2,(0)Act2  +  MjaWAcjs  +  A,  21Mu(0)  +  M„(0)&,Mu(0) + Ml2(0)5i>Vf  l3(0) 

+f;1(0)f22f12(0)+qI2-o.  (i3) 

A'cnWu(0) + MjatOlAca  +  Ml3(0)5aMu(0)  +  Pa(0)R„F22(0)  +  Q-j  -  0.  ( 14) 
From  (13)  we  have 

Mjj  -  - [AJ 2t  M»(0>  +  M2l(0) A, , j  +■  M,  ,(0)S«Ml3(0)  +  M.jtOlSjjM.jfO) 

+ p2i(0)R.2Fa(0)+ QZ2]a;l. 
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Substituting  for  Ma  in  (12)  and  using  Eq.  (14)  we  obtain  an  equation  identical 
to  (8),  where  M2,( 0),  Mu(0),  Ml2(0),  Mu(0),  FZI( 0),  Fa(0)  replace  K*  Ku, 

K»*  Kl3,  L2i,  La  respectively. 

Decomposing  Eq.  (Id)  and  letting  ti  —  0,  we  obtain 

A,  uN’jj(O) + N21(0)AJ  u+A.  nNa(O) + tf»(0)  AJ  l2 + /  »  0,  (15) 

N21(0)A;2t + S7a(Q)A'ta  -  0,  (16) 

jiFjj + MjjAJ  ji + A,a^a  ^  *  0-  (17) 

From  (16),  we  get  Na(0)-  -N21(0)A;21(At'j2)'-N2l(0)V'.  From  (17),  we  get 
Na(0)«  VN2l(0)V",  where 

v«  -  ac22a,2,. 

Substituting  lor  in  (15),  we  obtain 

(A*,! — A,  i2At  22i^«ii)^ii(0) +  ^ii(0)(A,u  —  A,  «2Ae  jjA^i)*  +  f  •  0, 

which  is  identical  to  (A2),  where  N2l(0),  Mu(0),  Mn( 0).Mo,(0).  ffcJ0),FaC») replace 
P2.  Ku,  Kv2,  Kl3,  L2j,  La  respectively.  After  decomposing  (lc)  and  letting 
p.  -*  0,  we  obtain 

[AlllNll(0)+Acl2N,i2(0)-(5tlM,l(0)+5l2Mi2(0))iV2l(0)-Sv2Ma(0)Ni2(0) 

+ ($s,M„(0) + ^jM'l2(0))N2,(0) + 5uM,.,(0)N5,(0)] + [tf,  ,(0)  A;  n 
+  12(0)  a;  l2  -  N2l(0)(M2l(0).f  t ,  +  MafO  )S'l2)  -  tfa(0)Mu(0)5'l2 + N21(0) 

x  (M,  ,(0)$2l  +  .V/12(0 )&) + Nu(0)MM(0)f S,]  -  0,  (18) 
Nn(0)A;2t  +  N12(0)AJa  *  N21(0XM2S(0)$21  +  Ma(0)Sl3)  -  N«(0)Mm(0)$13 
+  N2,(0HMu(0)5a  +  Ml2(0)5a)  +  ^a(0)M„(0)5a  -  0.  (19) 
A.2lNl2(0)  +  AeaNlJ(0)  ♦  N'l2(0)AJ  2I  +  l3(0)A;a  ”  7*,.Va(0)  -  <V'a«»TS 

—  T*Na(0)  -  Na(0)7*  “  0.  (20) 


From  (19)  we  obtain 


where 


utf»  -  N3,(0)  W*  +  u(0)  V\ 


W-A,-i(T,  +  T4V), 

T,  =■  5,jM'a(0)  +  5'l2M2l(0)  -  5aM'u(0)  -  $'nSfx  ,(0). 
T4-5t2Ma(0)-laMl3(0). 

Substituting  for  Nl2(0),  Ma(0),  Na(0)  in  (18),  we  get  an  equation  identical  to 
(Al)  where  Nlt(0),  tf21(0),  M2l(0),  Mu( 0).  F2l(0),  Fa(0).  Ml3(0),  Ml2(0) 
replace  Plt  P2,  K2,  Kn,  Lji,  La>  Ki3,  Ki2,  respectively. 

Substituting  for  N'u(O),  Na(0),  Ma(0)  in  (20)  and  using  Eq.  (14),  we  get  an 
equation  identical  to  (A5),  where  ,VU(0).  .VH(0),  iV2,(0),  M2,(0),  Mu(0), 
MI2(0),  M,3(0),  Fji(0),  Fj2(0)  replace  P3,  Plt  P2,  K2,  Kn,  K(2,  Kl3,  L2j,  L22 
respectively. 
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Decomposing  (le)  and  letting  n  -*0,  we  have 

R,:(Fli(0)Nll(0)  +  Fa(0)N'12(0)) + RM(F2l(0)N„(0) 

+  0))  -  B'uMu(0)Nu(0)  -  Bfe(M'u(0)N,  ,(0) + MJPMffl) 

-  B',2M2,(0)N2l(0)  - Bi,(Mia(0)Nj1(0) +^(0)^(0))  -  0,  (21) 
(H,*F«(0)— Bt»Mu(0)  -  BbA/'u(0))Nia(0) 

+(RaFI1(0)  -  Bi2»Vfj,(0)  -  BfeMfeOWN^Q) 

+(R«Fb4D)“Bj,i  MoCOJjN^O+lRaFta  0)— BjjMufOlNjjfO)  *0.  (22). 

Substituting  (or  Nt2(0),  NjJi 0),  Mm(0)  and  Na(0)  in  Eqs.  (21)  and  (22)  and 
using  Eq.  (14),  we  get  Eq.  (21)  identical  to  (A3)  and  Eq.  (22)  identical  to  (A4), 
where  Nu( 0),  tf2l(0),  M2,(0),  Afu(0),  Mu( 0),  Mu(0).  F2l(0)  Fa(0)  and  .Vu(0) 
replace  Plt  P2>  K2,  Kn,  K12,  K,3.  Llt,  and  P3  respectively. 

To  compare  the  performance  indices  resulting  from  solving  the  full  order 
problem  with  the  ones  resulting  from  the  redaced  order  solution  we  need  the 
following  assumptions: 

(a)  The  fast  optimization  problem  of  the  follower  has  a  unique  stabilizing 
solution.  In  other  words  there  exists  a  unique  f.l3  which  is  a  solution  of  Eq.  (3) 
for  each  Lu  applied  such  that  A.(A22)<0. 

(b)  The  slow  optimization  problem  of  the  follower  has  a  unique  solution 
after  substituting  for  Ll2  from  the  fast  problem,  i.e.  Eqs.  (6)  and  (7)  have  a 
unique  solution  for  Ku,  Kl£. 

(c)  The  leader  optimization  problem  has  a  unique  stabilizing  solution,  i.e. 
there  exists  a  unique  pair  L21  and  La  as  a  solution  of  the  set  of  Eqs.  (3),  (6), 
(7),  (8)  and  (A1HA5)  such  that  A(Ao)<0. 

Theorem 

If  assumptions  (a),  (b)  and  (c)  are  satisfied  then: 

(1)  lim  (u,  -Uu,)  -0,  for  i  -  1, 2, 


(2)  lim  (Ji-JD-O. 

m—O 

where 

Uj^»-L,,x-L,2z,  u,--Fux-FjZ, 

JT  is  the  performance  index  when  u,  and  u2  are  used, 

J,  is  the  performance  index  when  ulw  and  are  used. 

Proof:  (1)  It  was  shown  that  M„(0),  Ml2(0).  Ml3( 0),  M2X(0),  Nu(0),  S2l(0), 
*„(0).  F2l(0),  Fjj(0)  replace  K\\,  K  i2,  FCi3,  /C2,  Pi,  P2,  P3,  L-i,  La  res  pec* 
tively  in  the  equations  and  if  the  uniqueness  assumptions  are  satisfied,  then  we 
have  unique  values  of  Ku,  Kt2,  fCi3,  fC2,  Pi,  P2,  P3,  L2X,  La  and  K ( ( m  iVfu(O), 
Ku-M„(0).  FCt3 » Mt3(0),  FIX(0)*  Lji,  Fjj(0) *  L22,  fC2 *  W2I(0),  Pi* 
N„(0),P2-^2,(0).P3-N,3l0). 
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For  the  follower: 


uim  m  ”k»»*  “ 


Substituting  for  Ln,  Ln,  we  obtain 

u\—  m  ~Rii(B\iKu+ BiiK'ii)*  —  RiiBiiK&z. 


But  the  exact  control  of  the  follower  is: 


“i 


Mu 

mm;2 


ir  x' 

mMjjJU  J’ 


-  -H7i[B'„(Mux + nMuz)  +  BjaM'uX  +  M„r)l 

-  -RTiC(B'uMu  +  Bi»M'ia)x  + , iB'„Mur  +  M^r]. 


Dearly. 


lim  Ui  *  lim  utap. 

js—0  o 

For  the  leader: 

u2  m  -Fux  -  FJ2r, 
u2^»-L22x-L2ar. 

Clearly, 


lim  uj*  lim  uv 

is— O  is— O 


(2)  When  the  exact  controls,  u, »  -F,y  and  u,  -  -F2y  are  used  the  resulted 
performance  index  yoMyp  where  M  is  given  by  Eqs.  (la),  (lb).  If  ulaw 
and  are  used,  where 


“us 


-R;}B\Kiy,  Kt 


kn  0  1 

mKJ' 


we  will  have  J,  as  the  performance  index,  where  /i*]yGWiyo  and  Wt,  W2 
satisfy  the  following  equations: 

Wt(A  -  SulCt  -  BjLj) + (A  -  SuKt  -  B*L,)'  Wt  +  Qt  +  HCtSu£i + LiRuLi  -  0, 

(23) 

W2(A  -  S„#C,  -  B,Lj) +(A  -  S„  fCt  -  BjLJ'Wj  +  Q2  IC,S,,X,  +  LiR«L2  -  0. 

(24) 


Subtracting  (23)  from  (24)  and  (la)  from  (lb),  we  find  that 
P,  -  W,-M,  and  P2«  W2-M2 

satisfy 

P,(A  - S„K,  -  B:Lj)  +  ( A  - SuKt  - BjL^'P,  +  (K,  - M,)'S, ,(PC  - Mt) 

+  M,B2(L2  -Fj)  +  (Lj  -  FjJ'BiM,  L2R,2L2  -  F'2R12F2  -  0.  (25) 
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P2(A  "SnKj“  BjLj)+(A  "SuK|  ■  BjLJPj+KiSjiKi  — 

-  MjS,  ,(Kt  -  M,)  -  (X,  -  -  Fj) 

-(Lj-FaJ'SJMa+LiRa^-FjFjaFj-O.  (26) 

Taking 

p.fPa  »^,*1 

‘  LfiFa  mF.J 

and  substituting  for  P,  and  P2  in  Eqs.  (25)  and  (26)  respectively  and  setting 
I*  -*  0,  we  obtain 

Pii'An  +  ^ai^ji  +  A'u^il  +  AjjPij*0,  (27) 

PuAu+P«ai^»+ AjiPu“0  (28) 

^jAa+A^Po-O.  (29) 

Since  As  is  stable,  Pl3*0  is  the  unique  solution  of  Eq.  (29).  From  (28)  we 
have 

Pt2*  —  [Pii^uJAn- 
Substituting  Pl2  in  (27),  we  obtain 

Pa(Ati~  AaA22IA2l)+(Att  — Ai2AaA2i)  Pa*0 
or  PnAo+AoP,i«0.  Since  A0  is  stable,  Pu»0.  Thus 
PM-  0  for  i  ■  1,2,  /  -1,2,3. 


Conclusion 

In  the  method  described  in  this  paper  we  managed  to  decrease  the  amount  of 
computation  and  alleviate  the  numerical  stiffness  which  we  would  have  if  we 
solve  the  full  order  problem.  In  this  method  the  follower  finds  his  gains  in  a 
way  similar  to  the  hierarchical  reduction  scheme  described  in  (8).  That  is,  the 
fast  gain  is  obtained  from  solving  a  fast  optimization  problem  independent  of 
the  slow  information  and  the  slow  gain  is  obtained  from  solving  a  modified 
slow  optimization  problem.  The  leader  finds  his  gains  by  minimizing  the  slow 
part  of  his  cost  function  under  the  constraint  that  the  follower  applies  the 
above  procedure. 

It  was  shown  that  if  we  apply  the  strategies  obtained  from  this  method  to  the 
full  order  system,  the  resulting  cost  functions  will  have  the  same  limits  as  the 
cost  functions  for  the  same  full  order  system  if  the  full  order  optimal  strategies 
are  applied. 
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Appendix  A 

Applying  the  matrix  minimum  principle  (12)  to  the  leader  optimization  problem  we 
get  the  following  set  of  matrix  algebraic  equations: 

Pi  Aii  —  F  iXnJ||-P|L'nfl'u-P  -PiKijJij+PiAiir'i +  PjXj») 

•r  PjKitSii*  P +  Pj#Cu5*i  +  PjKuSair'i  +  Pi<5nAn(5|j-'-  Suw'i) 

—  PjA'hIAxx)' -(K|j5jj  +  K1J5u’r'i)—  PjAji(Aji)’(3»A-j($i  j  +  5«iTi) 

+  AitP  i—SuKiiP  i  —  BizLuP  i  “riJuXuPi*SiiX|jP,  +  triAjtPi 

•V  TT'jKjP  j  +  WiSijKi  (P,  +•  7T  [5uK‘ jPj  +■  SiiKuPi  +  ShK'ijPi 

~('*iSts/Cij  +  SxxK  u)Au  AjiPj +( »i5u  4  S13)  *  (Ajj)'OjjPj 
“  +  Wi5tj)(  A  aVOiiiAuJAjiPj  ■  0,  (Al) 

PjAo  +  AoPim0,  (A2) 

—  BljKuP  i  ”ff)5uX!jP  i  +  VjAj|P  i  —  B  JjX'uP  t  +  r»XjP|+ RaL’iPi 

+  Wj^aJC’uPj  +  rrj5jjJfiiPi  +  Rijf^iPi  —  (Rjjf-a  +  wt5jjJCij)A-j  AjiPt 

+(irj5ij  +  Bjj)(Ajj)'OjjPj— (Bij  +  e}$tj)(  Atj'yOjsAjs  Aj|P-*  0,  (A3) 

—  ir'fP,Kij$t}(A j})  ^irJP i A;i(A n)‘  +  irJPjJCiff*  +  6jKjP »A;j(A ti)' 

*  tr'tPiKuSnlA  a')' it jPjPCi j5«( A-j)'  ~  PuLjiP j  (A^  ) 

—  iTjPjA  j|(Aa)'/Clj5a(A;5)'  —  Ba(A:i)’(332P;A:i(Ay')' 
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(Ad) 


+  S»(A«)'<3u(A«)Ai«PiAjiAa),+RJjLtf  (An  )  AaPi  An  (Aja) 

~  BjjKujPj  *  0, 

-ASAj.P.Ai, + Ai'SuKa^Ai,  +  A„PaKi(3„- AnAi'SaXAJJ)' 

+  An  AjiP*  JC*(5«-  AuAJjftj)  -  AJj  Aj,Pi0uAn  5,j  -  AjjPifJaAaSutAu)' 

-AaAnPjKuSa- A«  AnP;Ku5n  + AjiPjAij^ayKijJuCAij) 

+A1,P;A;1(Aa1y<3uAa^ij(Al1ly+(Aa)AiiPjAii(Aa),<5aAa5,j+(Aij  A:lPj 
xAJ^Aa'yKu^ AaPj- (AjjjJjjKuPiAij-Aia  SjjKijPj  Aa“^jiPi  Aii(Ajy) 
■►AjtPcAkiitAtjy  ■^(AaM^ij  — AijAa'Su)  KjPjA ji  +  (5u  —  AjjA  jjSu)  K^PjAn 
x(Ai‘y-f1J(AJiyQi2P:A',l(Ai1,y-(A«)5^Xa‘y<3'aP1Ai1-5i1KtlPlAi,lA^y 
-SSJJC#,SP!AS,(Ai‘y+(Aj*,>SaKlJ(Ai,)As,PsAi,+(Ai,)5tJ(Ai,y<5a(Ai') 

xA;iPjA!,+ 5,j(AalyOu(A  aiAitPiAJ^Aa)' +  5uXu(Aa)Aj»PjAjt(Aj2) 

+PjAJi- AjiP3Kit5a(Aaly“ AnPifCia5a(Au’)  *0.  (AS) 


where 

1f|  *  (  “  A|j  +  0|}Lu  +  Stl(f|l)A;j , 
irj  *  — 3t  i  -  +  AijAa(5»j  *■  ■Ju  ’^1). 

*>  *  (*^  i  Aa  *  ®1j^u)As> 

it*  Btl  + AijAjiCBa  +  ^iji^l. 

■»j  *  *{LiiRu“KiiBu+(Qti^£.'nRijLn+KitAij-KiiBtjLa 

+  A  ;,/C,j)Aa  Ba]. 

ir»  m  —  512(A  a)' + A(  j  A  a  SuCAa)',  6j  m  Bu  “  AjjA»  Ba- 

So  in  order  for  the  leader  to  find  L-\,  La  he  has  to  solve  Eqs.  (3),  (6),  (7),  (8),  and 
(A1HA5). 


